-- Logs begin at Fri 2021-02-19 04:14:40 UTC, end at Fri 2021-02-19 05:20:43 UTC. -- Feb 19 04:49:52.530968 dv-cinder-776422-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Feb 19 04:49:52.538637 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Feb 19 04:49:52.540799 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: *** Starting uWSGI 2.0.15-debian (64bit) on [Fri Feb 19 04:49:52 2021] *** Feb 19 04:49:52.540799 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: compiled with version: 7.3.0 on 28 September 2018 15:41:15 Feb 19 04:49:52.540799 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: os: Linux-4.15.0-55-generic #60-Ubuntu SMP Tue Jul 2 18:22:20 UTC 2019 Feb 19 04:49:52.540799 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: nodename: dv-cinder-776422-3-iscsi Feb 19 04:49:52.540799 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: machine: x86_64 Feb 19 04:49:52.540799 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: clock source: unix Feb 19 04:49:52.540799 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: pcre jit disabled Feb 19 04:49:52.540799 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: detected number of CPU cores: 4 Feb 19 04:49:52.540799 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: current working directory: / Feb 19 04:49:52.540799 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: detected binary path: /usr/bin/uwsgi-core Feb 19 04:49:52.540799 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: dropping root privileges as early as possible Feb 19 04:49:52.540799 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: your processes number limit is 47843 Feb 19 04:49:52.540799 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: your memory page size is 4096 bytes Feb 19 04:49:52.540799 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: detected max file descriptor number: 2048 Feb 19 04:49:52.540799 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: lock engine: pthread robust mutexes Feb 19 04:49:52.542124 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: thunder lock: enabled Feb 19 04:49:52.542124 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Feb 19 04:49:52.542124 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: dropping root privileges after socket binding Feb 19 04:49:52.542124 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: Python version: 3.6.9 (default, Oct 8 2020, 12:12:24) [GCC 8.4.0] Feb 19 04:49:52.586278 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: Python main interpreter initialized at 0x55ed9cdb89c0 Feb 19 04:49:52.586278 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: dropping root privileges after plugin initialization Feb 19 04:49:52.586278 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: python threads support enabled Feb 19 04:49:52.586278 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: your server socket listen backlog is limited to 100 connections Feb 19 04:49:52.586278 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: your mercy for graceful operations on workers is 90 seconds Feb 19 04:49:52.586720 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: mapped 402621 bytes (393 KB) for 2 cores Feb 19 04:49:52.586720 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: *** Operational MODE: preforking *** Feb 19 04:49:52.586952 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: dropping root privileges after application loading Feb 19 04:49:52.586952 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: *** uWSGI is running in multiple interpreter mode *** Feb 19 04:49:52.586952 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: spawned uWSGI master process (pid: 83289) Feb 19 04:49:52.587130 dv-cinder-776422-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Feb 19 04:49:52.587450 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: spawned uWSGI worker 1 (pid: 83290, cores: 1) Feb 19 04:49:52.587815 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: spawned uWSGI worker 2 (pid: 83291, cores: 1) Feb 19 04:49:52.587920 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Feb 19 04:49:57.125047 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2567}} Feb 19 04:49:57.125623 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2568}} Feb 19 04:49:57.126890 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2569}} Feb 19 04:49:57.127314 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2571}} Feb 19 04:49:57.127622 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2572}} Feb 19 04:49:57.128080 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.128439 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.128794 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.129403 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.129773 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.130117 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.130474 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.130827 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.131194 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.131510 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.131862 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.132229 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-776422-3-iscsi {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.132591 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.132937 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.133282 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.133639 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.133739 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2567}} Feb 19 04:49:57.133950 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2568}} Feb 19 04:49:57.134050 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.134309 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.134647 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.135259 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.135550 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2569}} Feb 19 04:49:57.135665 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.135940 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.136056 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2571}} Feb 19 04:49:57.136249 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2572}} Feb 19 04:49:57.136349 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.136636 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.136752 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.136980 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.137089 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.137322 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.137421 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.137678 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.137779 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.138019 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.138141 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.138377 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.138477 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.138715 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.138814 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.139122 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-776422-3-iscsi {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.139235 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.139501 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.139662 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.139849 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.140184 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.140285 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.140617 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.140777 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.140997 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-776422-3-iscsi {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.141099 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.141371 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.141479 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.141725 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.141830 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.142082 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.142186 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.142421 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.142541 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.142769 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.142867 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.143123 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.143232 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.143491 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.143611 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.143842 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.144112 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.144219 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.144464 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.144570 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.144802 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.144909 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.145148 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.145248 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.145478 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.145591 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.145813 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.145919 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.146092 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.146204 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.146428 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.146528 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.146788 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.146900 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.147143 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.147249 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.147525 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.147638 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.147805 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.147906 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-776422-3-iscsi {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.148086 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.148241 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.148441 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.148573 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.148804 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.148916 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.149147 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.149335 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.149484 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.149711 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.149870 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.150021 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.150184 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.150347 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.150495 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.150712 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.150863 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.151058 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.151167 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.151429 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.151544 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.151785 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.151885 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.152139 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.152240 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.152495 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.152595 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.152830 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.152941 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.153171 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.153273 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.153520 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.153625 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.47 {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.153856 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.47 {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.153956 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.154193 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.154295 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.154527 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.155136 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.155396 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.155628 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.155979 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.156175 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.156333 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.156440 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.156689 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.156812 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.157031 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.157143 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.157337 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.157448 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.157625 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.157737 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.157992 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.158092 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.158344 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.158459 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.158681 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.158781 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.158960 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.159059 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.159294 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.159429 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.159657 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.159758 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.160012 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.160111 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.160345 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.160455 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.160683 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.160790 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.161023 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.161122 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.161348 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.161452 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.161685 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.161797 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.162020 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.162126 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.162357 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.162457 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.162693 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.162793 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.163027 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.163126 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.47 {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.163387 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.163528 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.47 {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.163728 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.163847 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.164065 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.164174 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.164401 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.164523 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.164757 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.164866 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.165111 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.165219 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.165441 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.165557 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.165775 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.165884 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.166109 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.166224 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.166444 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.166568 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.166799 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.166907 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.167134 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.167250 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.167494 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.167614 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.167776 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.167900 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.168121 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.168234 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.168464 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.168639 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.168804 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.168965 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.169128 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.169275 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.169429 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.169561 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.169758 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.169909 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.170070 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.170216 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.171000 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.171282 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.171419 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.171671 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.171770 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.172053 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.172164 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.172404 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.172510 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.172732 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.172837 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.173069 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.173180 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.173409 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.173508 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.173743 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.173851 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.174077 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.174184 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.174409 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.174521 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.174758 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.174864 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.175099 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.175205 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.175480 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.175617 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.175809 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.175915 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.176145 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.176254 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.176503 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.176602 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.176842 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.176941 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.177191 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.177320 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.177558 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.177667 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.177898 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.178019 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.178234 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.178343 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.178599 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.178708 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.178941 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.179057 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.179279 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.179406 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.179646 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.179760 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.179983 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.180100 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.180326 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.180435 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.180671 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.180779 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.181007 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.181123 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.181348 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.181470 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.181692 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.181776 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.182026 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.182132 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.182367 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.182472 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.182709 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.182808 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.183043 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.183198 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.183404 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.183507 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.183739 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.183846 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.184098 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.184198 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.184450 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.184549 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.184792 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.184898 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.185135 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.185235 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.185479 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.185615 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.185839 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.185994 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:49:57.186347 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.186450 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.186732 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.186956 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.187095 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.187377 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.187482 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.187743 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.187868 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.188112 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.188238 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.188466 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.188560 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.188813 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.188922 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.189155 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.189264 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.189503 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.189612 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.189862 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.189972 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.190207 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.190322 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.190542 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.190657 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.190884 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.190999 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.191223 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.191373 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.191592 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.191707 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.191932 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.192052 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.192283 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.192383 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.192631 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.192731 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.192965 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.193076 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.193316 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.193415 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.193658 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.193768 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.194000 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.194101 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.194341 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.194440 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.194678 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.194799 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.195019 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.195119 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.195380 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.195484 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.195721 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.195822 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.196081 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.196181 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.196426 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.196535 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.196758 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.196858 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.197111 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.197211 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.197453 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.197625 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.197801 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.197952 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.198103 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.198252 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.198414 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.198575 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.198774 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.198931 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.199092 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.199240 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.199425 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.199599 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.199752 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.199914 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.200061 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.200208 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.200371 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.200525 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.200739 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.200891 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.201078 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.201228 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.201438 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.201656 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.201840 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.201986 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.202135 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.202445 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.202594 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.202765 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.202927 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.203087 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.203236 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.203425 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.203575 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.203738 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.203885 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.204033 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.204238 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.204388 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.204593 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.204745 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.204950 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.205113 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.205268 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.205430 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.205585 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.205733 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.205927 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.206127 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.206275 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.206422 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.206685 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.206843 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.206992 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.207140 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.207300 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.207418 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.207573 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.207681 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.207911 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.208011 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.208289 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.208397 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.208628 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.208734 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.208975 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.209083 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.209320 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.209488 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.209664 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.209764 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.210002 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = None {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.210107 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.210340 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = None {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.210448 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.210683 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.210788 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.211045 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.211145 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.211404 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.211520 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.211753 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.211883 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.212138 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.212301 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.212453 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.212615 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.212763 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.212919 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_vgpu_types = [] {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.213067 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.213215 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.213382 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.213530 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.213678 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.213846 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.213993 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.214142 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.214338 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.214489 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.214685 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.214849 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.215012 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.215160 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.215313 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.215446 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.215692 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.215802 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.216028 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.216139 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.216371 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.216472 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.216707 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.216807 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.217045 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.217646 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.218006 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.218109 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.218355 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.218689 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.218788 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.219021 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.219153 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.219388 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.219494 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.219742 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.219844 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.220102 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.220203 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.220447 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.220547 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.220803 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.220903 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.221153 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = None {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.221259 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.221484 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.221584 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = None {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.221822 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.221924 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.222188 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.222348 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.222503 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.222666 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.222813 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.222960 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.223121 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.223282 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.223499 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.223601 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.223859 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_vgpu_types = [] {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.223971 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.224208 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.224310 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.224545 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.224645 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.224893 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.225005 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.225240 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.225340 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.225582 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.225689 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.225928 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.226036 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.226265 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.226365 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.226604 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.226711 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.226953 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.227065 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.227293 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.227463 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.227684 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.227795 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.228022 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.228125 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.228365 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.228466 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.228700 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.228801 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.229041 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.229143 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.229387 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.229487 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.229721 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.229822 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.230058 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.230158 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.230393 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.230502 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.230732 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.230833 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.231074 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.231181 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.231446 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.231559 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.231809 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.232143 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.232258 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.232481 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.232590 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.232902 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.233003 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.233338 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.233440 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.233709 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.233926 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.234027 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.234282 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.234394 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.234634 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.234734 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.235037 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.235164 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.235401 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.235531 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.235748 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.235858 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.236088 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.236197 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.236425 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.236542 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.236768 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.236877 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.237107 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.237217 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.237446 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.237561 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.237785 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.237919 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.238127 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.238237 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.238463 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.238579 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.238798 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.238908 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.239135 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.239251 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.239500 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.239604 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.239845 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.239953 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.240175 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.240276 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.240518 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.240620 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.240855 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.240955 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.241200 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.241300 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.241536 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.241637 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.241873 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.241973 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.242216 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.242456 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.242603 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.242757 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.242923 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.243210 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.243406 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.243583 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.243740 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.243948 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.244053 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.244315 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.244416 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.244647 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.244748 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.244986 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.245092 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.245347 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.245456 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.245683 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.245783 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.246019 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.246119 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.246361 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.246470 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.246703 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.246818 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.247038 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.247138 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.247401 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.247516 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.247750 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.247856 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.248093 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.248217 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.248468 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.248611 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.248862 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.249054 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.249357 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.249541 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.249726 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.249897 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.250064 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.250247 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.250402 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.250599 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.250740 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.250950 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.251086 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.251310 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.251428 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.251684 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.251796 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.252039 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.252147 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.252389 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.252543 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.252693 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.252852 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.253038 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.253198 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.253347 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.253495 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.253687 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.253854 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.254258 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.254420 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.254620 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.254771 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.254971 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.255138 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.255300 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.255469 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.255649 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.255750 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.255986 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.256088 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.256323 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.256425 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.256661 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.256769 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.257002 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.257113 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.257338 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.257438 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.257673 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.257781 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.258008 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.258110 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.258347 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.258451 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.258682 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.258784 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.259029 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.259130 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.259422 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.259535 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.259702 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.259802 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.260039 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.260140 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.260373 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.260472 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.260717 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.260824 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.261063 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.261170 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.261404 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.261509 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.261751 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.261861 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.262096 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.262196 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.262441 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.262548 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.262783 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.262920 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.263112 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.263215 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.263491 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.263605 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.263837 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.263945 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.264763 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.264865 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.265116 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.265353 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.265453 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.265707 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.265813 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.266055 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.266155 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.266412 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.266524 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.266760 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.266860 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.267118 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.267219 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.267484 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.267605 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.267840 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.267945 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.268181 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.268295 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.268519 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.268639 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.268859 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.268959 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.269203 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.269308 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.269539 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.269649 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.269877 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.269976 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.270212 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.270311 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.270553 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.270660 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.270893 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.270998 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.271227 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.271344 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.271592 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.271717 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.271935 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.272043 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.272275 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.272389 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.272605 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.272735 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.272969 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.273080 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.273309 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.273410 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.273638 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.273742 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.273978 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.274078 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.274317 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.274416 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.274659 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.274767 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.274996 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.275095 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.275375 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.275547 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.275746 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.275848 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.276101 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.276201 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.276446 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.276553 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.276784 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.276883 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.277117 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.277223 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.277467 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.277574 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.277812 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.277912 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.278143 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.278242 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.278526 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.278621 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.278873 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.278981 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.279243 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.279368 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.279606 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.279845 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.279992 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.280160 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.280328 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.280671 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.280779 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.281023 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.281124 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.281352 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.281452 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.281689 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.281798 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.282025 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.282125 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.282372 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.282472 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.282702 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.282877 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.283127 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.283284 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.283500 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.283648 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.283796 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.283966 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.284114 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.284263 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.284409 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.284596 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.284757 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.284940 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.285100 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.285284 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.285435 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.285645 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.285805 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.286004 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.286171 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.286320 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.286468 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.286675 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.286841 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.287010 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.287157 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.287313 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.287496 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.287688 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.287853 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.288049 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.288213 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.288395 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.288546 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.288746 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.288892 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.289083 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.289234 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.289445 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.289625 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.289825 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.289987 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.290135 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.290281 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.290466 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.290616 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.290925 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.291118 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.291284 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.291507 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.291658 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.291854 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.292026 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.292214 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.292364 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.292578 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.292729 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.292920 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.293029 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.293262 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.293373 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.293600 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.293701 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.293931 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.294037 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.294274 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.294374 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.294611 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.294716 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.294949 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.295049 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.295828 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.296046 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.296147 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.296492 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.296613 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.296829 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.296954 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.297164 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.297390 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.297525 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.297751 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.297851 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.298108 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.298207 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.298483 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.298589 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.298846 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.298946 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.299204 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.299303 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.299568 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.299680 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.299930 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.300042 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.300272 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.300371 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.300608 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.300724 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.300946 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.301055 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.301296 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.301453 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.301632 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.301798 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.301961 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.302108 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.302256 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.302403 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.302614 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.302725 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.302970 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.303120 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.303295 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.303467 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.303690 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.304029 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.304129 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.304371 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.304470 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.304727 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.304835 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.305085 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.305184 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.305414 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.305513 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.305749 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.305856 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.306093 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.306191 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.306429 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.306538 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.306766 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.306884 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.307103 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.307211 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.307486 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.307600 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.307821 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.307921 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.308155 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.308260 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.308487 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.308587 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.308834 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.308935 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.309164 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.309272 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.309501 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.309600 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.309841 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.309953 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.310178 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.310289 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.310513 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.310613 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.310850 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.311023 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.311396 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.311538 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.311739 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.311863 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.312113 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.312231 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.312467 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.312603 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.312826 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.312944 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.313164 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.313274 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.313506 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.313609 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.313845 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.313947 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.314194 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.314316 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.314539 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.314640 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.314887 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.314987 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.315237 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.315366 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.315629 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.315730 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.315975 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.316082 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.316318 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.316420 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.316660 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.316770 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.317005 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.317115 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.317351 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.317459 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.317700 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.317807 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.318041 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.318330 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.318438 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.318692 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.318793 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.319029 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.319177 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.driver = filter_scheduler {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.319409 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.319516 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.319738 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.319839 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.320084 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.320198 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.320429 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.320540 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.320765 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.320865 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.321101 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.periodic_task_interval = 60 {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.321209 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.321441 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.321522 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.321783 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = False {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.321883 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.322124 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.322235 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.322469 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.322580 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.322815 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.322915 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.323160 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.323277 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.323532 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.323634 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.323878 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.323979 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.324227 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.324328 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.324581 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.324681 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.324934 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.325033 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.325301 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.325408 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.325657 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.325763 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.325995 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.326168 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.326348 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.326449 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.327241 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.327413 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.327685 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.327933 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.328034 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.328325 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.328426 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.328685 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.328792 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.329030 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.329130 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.329374 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.329556 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.329705 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.329854 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.330028 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.330178 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.330327 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.330558 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.330714 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.330863 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.331026 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.331175 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.331419 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.331710 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.331868 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.332027 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.332176 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.332381 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.332533 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.driver = filter_scheduler {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.332781 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.332938 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.333107 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.333287 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.333442 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.333655 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.333810 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.334017 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.334186 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.334378 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.334531 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.periodic_task_interval = 60 {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.334725 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.334876 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.335079 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.335246 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = False {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.335423 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = None {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.335572 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.335760 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.335928 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.336084 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.336231 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.336409 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.336510 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.336749 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.336856 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.337090 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.337238 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.337427 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = False {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.337535 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.337768 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.337877 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.338101 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.338202 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.338452 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.338552 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.338794 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.338902 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.339226 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.339401 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.339642 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.339796 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.340005 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.340114 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.340366 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.340466 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.340726 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.340837 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.341081 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.341190 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.341438 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.341538 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.341795 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.341895 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.342287 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.342434 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.342573 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.342709 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.342848 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.343191 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.343423 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.343586 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.343689 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.343922 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.344026 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.344265 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.344396 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.344606 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.344710 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.344944 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.345044 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.345286 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.345395 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.345620 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.345723 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.345978 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.346250 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.346358 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.346609 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.346728 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.346937 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.347038 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.347280 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.347411 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.347642 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.347748 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.347978 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.348077 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.348313 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.348422 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.348650 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.348752 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = None {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.348995 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.349103 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.349330 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.349466 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.349670 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.349771 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.350008 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.350110 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.350347 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.350454 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.350699 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.350849 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = False {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.351016 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.351137 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.351376 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.351480 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.351769 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.351884 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.352065 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.352166 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.352400 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.352683 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.352790 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.353063 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.353163 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.353421 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.353545 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.353757 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.353856 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.354099 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.354258 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.354469 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.354637 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.354785 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.354933 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.355162 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.355412 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.355591 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.355792 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.355965 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.356151 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.356317 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.356583 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.356757 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.356923 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.357070 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.357218 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.357367 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.357516 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.358383 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.358383 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.358670 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.358825 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.358979 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.359148 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.359310 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.359503 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.359683 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.359835 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.360005 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.360166 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.360315 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.360464 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.360659 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.360809 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.361004 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.361129 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.361347 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.361454 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.361687 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.361787 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.362029 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.362140 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.362382 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.362482 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.362725 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.362825 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.363072 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.363180 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.363445 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.363549 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.363788 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.363888 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.364127 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.364300 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.364448 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.364597 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.364745 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.364893 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.365098 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.365249 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.365439 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.365599 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.365799 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.365951 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.366165 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.366315 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.366476 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.366643 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.366791 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.366939 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.367101 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.367250 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.367477 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.367631 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.367804 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.367973 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.368160 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.368312 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.368557 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.368708 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.368911 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.369068 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.369289 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.369524 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.369685 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.369909 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.370018 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.370270 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.370423 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.370590 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.370692 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.370923 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.371071 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.371307 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.371491 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.371683 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.371794 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.372027 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.372138 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.372384 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.372490 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.372730 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.372830 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.373072 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.373179 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.373488 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.373653 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.373875 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.374057 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.374223 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.374565 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.374669 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.374918 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.375023 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.375263 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.375392 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.375643 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.375745 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.375979 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.376080 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.376326 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.376434 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.376661 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.376761 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.377012 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.377114 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.377350 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.377458 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.377697 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.377799 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.378039 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] database.use_db_reconnect = False {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.378140 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.378385 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.378501 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] database.use_tpool = False {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.378739 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.378839 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.379353 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.379457 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.379713 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.379825 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.380049 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.380149 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.380409 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.380510 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.380752 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.380854 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.381091 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.381192 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.381441 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.381586 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.381791 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.381943 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.382133 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.382312 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.382499 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.382677 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.382841 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.383029 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.383186 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.383432 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.383546 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.383825 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.384011 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.384186 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.384289 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.384500 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.384652 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.384870 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.385039 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.385204 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.385352 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.385516 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.385663 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.385820 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.385968 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.386203 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.386355 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.386556 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.386707 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.386905 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.387057 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.387248 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.387460 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.387628 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.387776 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.387988 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.388156 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.388319 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.388490 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.388645 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.388800 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.388953 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.389699 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.389830 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.389961 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.390111 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.390540 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.390706 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.390875 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.391026 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.391199 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.391408 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.391582 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.391733 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.391883 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.392032 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.392181 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.392330 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.392572 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.392725 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.392942 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.393108 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.393257 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=83290) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2591}} Feb 19 04:49:57.393424 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.393629 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] database.use_db_reconnect = False {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.393993 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] database.use_tpool = False {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.394385 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.394744 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.395118 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.395506 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.395881 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.396235 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.396608 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.396978 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.397342 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.397698 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.398079 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.398434 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.398793 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.399147 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.399530 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.399886 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.400242 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.400624 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.400999 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.401353 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.401726 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.402095 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.402466 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.402828 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.403184 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.403593 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.403953 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.404315 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.404696 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.405609 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.406251 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.406767 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.407156 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.407585 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.407961 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.408339 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.408745 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.409103 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.409503 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.409885 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:49:57.410169 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=83291) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2591}} Feb 19 04:49:57.430322 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG oslo_db.sqlalchemy.engines [None req-13beb709-395f-40b9-8398-dd8d9f796d17 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=83290) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Feb 19 04:49:57.447682 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG oslo_db.sqlalchemy.engines [None req-4a13cad9-6dbe-4187-9381-56b602bdd900 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=83291) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Feb 19 04:49:57.691766 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.context [None req-13beb709-395f-40b9-8398-dd8d9f796d17 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),8317eecd-4287-4458-b94f-e801df0b7699(cell1) {{(pid=83290) load_cells /opt/stack/nova/nova/context.py:466}} Feb 19 04:49:57.698904 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG oslo_concurrency.lockutils [None req-13beb709-395f-40b9-8398-dd8d9f796d17 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=83290) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 04:49:57.700764 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG oslo_concurrency.lockutils [None req-13beb709-395f-40b9-8398-dd8d9f796d17 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=83290) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 04:49:57.702252 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG oslo_concurrency.lockutils [None req-13beb709-395f-40b9-8398-dd8d9f796d17 None None] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=83290) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 04:49:57.704394 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG oslo_concurrency.lockutils [None req-13beb709-395f-40b9-8398-dd8d9f796d17 None None] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=83290) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 04:49:57.719057 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.context [None req-4a13cad9-6dbe-4187-9381-56b602bdd900 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),8317eecd-4287-4458-b94f-e801df0b7699(cell1) {{(pid=83291) load_cells /opt/stack/nova/nova/context.py:466}} Feb 19 04:49:57.726354 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG oslo_concurrency.lockutils [None req-4a13cad9-6dbe-4187-9381-56b602bdd900 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=83291) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 04:49:57.728251 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG oslo_concurrency.lockutils [None req-4a13cad9-6dbe-4187-9381-56b602bdd900 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=83291) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 04:49:57.729180 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG oslo_concurrency.lockutils [None req-4a13cad9-6dbe-4187-9381-56b602bdd900 None None] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=83291) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 04:49:57.729669 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG oslo_db.sqlalchemy.engines [None req-13beb709-395f-40b9-8398-dd8d9f796d17 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=83290) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Feb 19 04:49:57.730571 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG oslo_db.sqlalchemy.engines [None req-13beb709-395f-40b9-8398-dd8d9f796d17 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=83290) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Feb 19 04:49:57.731386 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG oslo_concurrency.lockutils [None req-4a13cad9-6dbe-4187-9381-56b602bdd900 None None] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=83291) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 04:49:57.759423 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG oslo_db.sqlalchemy.engines [None req-4a13cad9-6dbe-4187-9381-56b602bdd900 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=83291) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Feb 19 04:49:57.760289 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG oslo_db.sqlalchemy.engines [None req-4a13cad9-6dbe-4187-9381-56b602bdd900 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=83291) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Feb 19 04:49:57.762461 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG oslo_db.sqlalchemy.engines [None req-13beb709-395f-40b9-8398-dd8d9f796d17 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=83290) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Feb 19 04:49:57.792689 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG oslo_db.sqlalchemy.engines [None req-4a13cad9-6dbe-4187-9381-56b602bdd900 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=83291) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Feb 19 04:49:57.863629 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 19 04:49:57.863629 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: from cryptography.utils import int_from_bytes Feb 19 04:49:57.864028 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 19 04:49:57.864028 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: from cryptography.utils import int_from_bytes Feb 19 04:49:57.877887 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 19 04:49:57.877887 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: from cryptography.utils import int_from_bytes Feb 19 04:49:57.878279 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 19 04:49:57.878279 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: from cryptography.utils import int_from_bytes Feb 19 04:49:57.940356 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: INFO keyring.backend [None req-13beb709-395f-40b9-8398-dd8d9f796d17 None None] Loading Gnome Feb 19 04:49:57.957476 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: INFO keyring.backend [None req-4a13cad9-6dbe-4187-9381-56b602bdd900 None None] Loading Gnome Feb 19 04:49:57.961659 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: INFO keyring.backend [None req-13beb709-395f-40b9-8398-dd8d9f796d17 None None] Loading Google Feb 19 04:49:57.964943 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: INFO keyring.backend [None req-13beb709-395f-40b9-8398-dd8d9f796d17 None None] Loading Windows (alt) Feb 19 04:49:57.970347 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: INFO keyring.backend [None req-13beb709-395f-40b9-8398-dd8d9f796d17 None None] Loading file Feb 19 04:49:57.971476 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: INFO keyring.backend [None req-13beb709-395f-40b9-8398-dd8d9f796d17 None None] Loading keyczar Feb 19 04:49:57.971930 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: INFO keyring.backend [None req-13beb709-395f-40b9-8398-dd8d9f796d17 None None] Loading multi Feb 19 04:49:57.972809 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: INFO keyring.backend [None req-13beb709-395f-40b9-8398-dd8d9f796d17 None None] Loading pyfs Feb 19 04:49:57.978789 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: INFO keyring.backend [None req-4a13cad9-6dbe-4187-9381-56b602bdd900 None None] Loading Google Feb 19 04:49:57.982225 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: INFO keyring.backend [None req-4a13cad9-6dbe-4187-9381-56b602bdd900 None None] Loading Windows (alt) Feb 19 04:49:57.987799 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: INFO keyring.backend [None req-4a13cad9-6dbe-4187-9381-56b602bdd900 None None] Loading file Feb 19 04:49:57.988909 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: INFO keyring.backend [None req-4a13cad9-6dbe-4187-9381-56b602bdd900 None None] Loading keyczar Feb 19 04:49:57.989359 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: INFO keyring.backend [None req-4a13cad9-6dbe-4187-9381-56b602bdd900 None None] Loading multi Feb 19 04:49:57.990226 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: INFO keyring.backend [None req-4a13cad9-6dbe-4187-9381-56b602bdd900 None None] Loading pyfs Feb 19 04:49:58.258637 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: WARNING keystonemiddleware.auth_token [None req-13beb709-395f-40b9-8398-dd8d9f796d17 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Feb 19 04:49:58.266317 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: WARNING keystonemiddleware.auth_token [None req-13beb709-395f-40b9-8398-dd8d9f796d17 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Feb 19 04:49:58.279745 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: WARNING keystonemiddleware.auth_token [None req-4a13cad9-6dbe-4187-9381-56b602bdd900 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Feb 19 04:49:58.287417 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: WARNING keystonemiddleware.auth_token [None req-4a13cad9-6dbe-4187-9381-56b602bdd900 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Feb 19 04:49:58.602660 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: WARNING keystonemiddleware.auth_token [None req-13beb709-395f-40b9-8398-dd8d9f796d17 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Feb 19 04:49:58.608857 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: WARNING keystonemiddleware.auth_token [None req-13beb709-395f-40b9-8398-dd8d9f796d17 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Feb 19 04:49:58.614236 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55ed9cdb89c0 pid: 83290 (default app) Feb 19 04:49:58.616601 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi [None req-13beb709-395f-40b9-8398-dd8d9f796d17 None None] Calling method '>' {{(pid=83290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 04:49:58.617809 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: INFO nova.api.openstack.requestlog [None req-13beb709-395f-40b9-8398-dd8d9f796d17 None None] 10.222.0.47 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001867 Feb 19 04:49:58.618251 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: [pid: 83290|app: 0|req: 1/1] 10.222.0.47 () {50 vars in 779 bytes} [Fri Feb 19 04:49:58 2021] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 04:49:58.631315 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: WARNING keystonemiddleware.auth_token [None req-4a13cad9-6dbe-4187-9381-56b602bdd900 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Feb 19 04:49:58.637407 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: WARNING keystonemiddleware.auth_token [None req-4a13cad9-6dbe-4187-9381-56b602bdd900 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Feb 19 04:49:58.644465 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55ed9cdb89c0 pid: 83291 (default app) Feb 19 04:51:29.375936 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi [None req-42de0803-eec9-4f9c-8554-b88d3ab4ff27 admin admin] Calling method '>' {{(pid=83290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 04:51:29.402239 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: INFO nova.api.openstack.requestlog [None req-42de0803-eec9-4f9c-8554-b88d3ab4ff27 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/detail" status: 200 len: 15 microversion: 2.1 time: 0.518773 Feb 19 04:51:29.402976 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: [pid: 83290|app: 0|req: 2/2] 10.222.0.47 () {58 vars in 1150 bytes} [Fri Feb 19 04:51:28 2021] GET /compute/v2.1/flavors/detail => generated 15 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 19 04:51:32.333779 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi [None req-48afe254-aa5b-489f-b503-1f60214745f1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "cirros256", "ram": 256, "vcpus": 1, "disk": 1, "id": "c1", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=83291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 04:51:32.360103 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 04:51:32.360103 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: warnings.warn(msg) Feb 19 04:51:32.390203 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: INFO nova.api.openstack.requestlog [None req-48afe254-aa5b-489f-b503-1f60214745f1 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 367 microversion: 2.1 time: 0.405057 Feb 19 04:51:32.390854 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: [pid: 83291|app: 0|req: 1/3] 10.222.0.47 () {62 vars in 1183 bytes} [Fri Feb 19 04:51:31 2021] POST /compute/v2.1/flavors => generated 367 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 04:51:32.402385 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi [None req-8b3fce22-6887-43c1-af3d-e1e03ee0d9c9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=83290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 04:51:32.405496 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 04:51:32.405496 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: warnings.warn(msg) Feb 19 04:51:32.447194 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: INFO nova.api.openstack.requestlog [None req-8b3fce22-6887-43c1-af3d-e1e03ee0d9c9 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.048889 Feb 19 04:51:32.447867 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: [pid: 83290|app: 0|req: 3/4] 10.222.0.47 () {62 vars in 1236 bytes} [Fri Feb 19 04:51:32 2021] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 19 04:51:32.458964 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi [None req-28298afe-ea85-4fde-842c-ad7896b93bed admin admin] Calling method '>' {{(pid=83291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 04:51:32.479315 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: INFO nova.api.openstack.requestlog [None req-28298afe-ea85-4fde-842c-ad7896b93bed admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.024407 Feb 19 04:51:32.479948 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: [pid: 83291|app: 0|req: 2/5] 10.222.0.47 () {58 vars in 1183 bytes} [Fri Feb 19 04:51:32 2021] GET /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 19 04:51:35.150353 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi [None req-a0b23ba5-2456-4746-8593-5ac2961bf355 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds512M", "ram": 512, "vcpus": 1, "disk": 5, "id": "d1", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=83290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 04:51:35.173544 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 04:51:35.173544 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: warnings.warn(msg) Feb 19 04:51:35.201134 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: INFO nova.api.openstack.requestlog [None req-a0b23ba5-2456-4746-8593-5ac2961bf355 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 364 microversion: 2.1 time: 0.128600 Feb 19 04:51:35.201746 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: [pid: 83290|app: 0|req: 4/6] 10.222.0.47 () {62 vars in 1183 bytes} [Fri Feb 19 04:51:35 2021] POST /compute/v2.1/flavors => generated 364 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 04:51:35.213092 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi [None req-d61c306d-732e-4ffb-a805-8c9e41679caf admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=83291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 04:51:35.214762 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 04:51:35.214762 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: warnings.warn(msg) Feb 19 04:51:35.254397 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: INFO nova.api.openstack.requestlog [None req-d61c306d-732e-4ffb-a805-8c9e41679caf admin admin] 10.222.0.47 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.045274 Feb 19 04:51:35.255311 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: [pid: 83291|app: 0|req: 3/7] 10.222.0.47 () {62 vars in 1236 bytes} [Fri Feb 19 04:51:35 2021] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 19 04:51:35.266344 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi [None req-b82ad7c2-2b07-451f-bbf7-61073260859b admin admin] Calling method '>' {{(pid=83290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 04:51:35.283623 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: INFO nova.api.openstack.requestlog [None req-b82ad7c2-2b07-451f-bbf7-61073260859b admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.021557 Feb 19 04:51:35.284257 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: [pid: 83290|app: 0|req: 5/8] 10.222.0.47 () {58 vars in 1183 bytes} [Fri Feb 19 04:51:35 2021] GET /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 19 04:51:37.937557 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi [None req-ca81b2e0-7e88-4c0b-b0af-a77dc9a0e3e7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds1G", "ram": 1024, "vcpus": 1, "disk": 10, "id": "d2", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=83291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 04:51:37.962756 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: INFO nova.api.openstack.requestlog [None req-ca81b2e0-7e88-4c0b-b0af-a77dc9a0e3e7 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 364 microversion: 2.1 time: 0.087223 Feb 19 04:51:37.964164 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: [pid: 83291|app: 0|req: 4/9] 10.222.0.47 () {62 vars in 1183 bytes} [Fri Feb 19 04:51:37 2021] POST /compute/v2.1/flavors => generated 364 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 04:51:37.976189 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi [None req-5f842c2c-e388-4857-b1bd-a38ac4141205 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=83290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 04:51:38.016609 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: INFO nova.api.openstack.requestlog [None req-5f842c2c-e388-4857-b1bd-a38ac4141205 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.044920 Feb 19 04:51:38.017257 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: [pid: 83290|app: 0|req: 6/10] 10.222.0.47 () {62 vars in 1236 bytes} [Fri Feb 19 04:51:37 2021] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 19 04:51:38.027946 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi [None req-04aa36b9-b65b-4b6c-8fc5-97cf10fdf9df admin admin] Calling method '>' {{(pid=83291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 04:51:38.044706 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: INFO nova.api.openstack.requestlog [None req-04aa36b9-b65b-4b6c-8fc5-97cf10fdf9df admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.020911 Feb 19 04:51:38.045321 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: [pid: 83291|app: 0|req: 5/11] 10.222.0.47 () {58 vars in 1183 bytes} [Fri Feb 19 04:51:38 2021] GET /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 19 04:51:40.680254 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi [None req-3160d22e-7dc4-43d4-b98a-864e433ebb48 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds2G", "ram": 2048, "vcpus": 2, "disk": 10, "id": "d3", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=83290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 04:51:40.705623 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: INFO nova.api.openstack.requestlog [None req-3160d22e-7dc4-43d4-b98a-864e433ebb48 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 364 microversion: 2.1 time: 0.089013 Feb 19 04:51:40.706268 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: [pid: 83290|app: 0|req: 7/12] 10.222.0.47 () {62 vars in 1183 bytes} [Fri Feb 19 04:51:40 2021] POST /compute/v2.1/flavors => generated 364 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 04:51:40.718579 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi [None req-d2a8fda3-c9f5-4112-8e68-3e74f5728053 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=83291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 04:51:40.759692 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: INFO nova.api.openstack.requestlog [None req-d2a8fda3-c9f5-4112-8e68-3e74f5728053 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.045740 Feb 19 04:51:40.760246 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: [pid: 83291|app: 0|req: 6/13] 10.222.0.47 () {62 vars in 1236 bytes} [Fri Feb 19 04:51:40 2021] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 19 04:51:40.771113 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi [None req-cb262418-6922-443e-bd48-726957fae601 admin admin] Calling method '>' {{(pid=83290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 04:51:40.786867 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: INFO nova.api.openstack.requestlog [None req-cb262418-6922-443e-bd48-726957fae601 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.019702 Feb 19 04:51:40.787501 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: [pid: 83290|app: 0|req: 8/14] 10.222.0.47 () {58 vars in 1183 bytes} [Fri Feb 19 04:51:40 2021] GET /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 19 04:51:43.427496 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi [None req-7945ec57-39ef-4a8c-82c0-96aae8294fcf admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds4G", "ram": 4096, "vcpus": 4, "disk": 20, "id": "d4", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=83291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 04:51:43.451084 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: INFO nova.api.openstack.requestlog [None req-7945ec57-39ef-4a8c-82c0-96aae8294fcf admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 364 microversion: 2.1 time: 0.083015 Feb 19 04:51:43.451755 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: [pid: 83291|app: 0|req: 7/15] 10.222.0.47 () {62 vars in 1183 bytes} [Fri Feb 19 04:51:43 2021] POST /compute/v2.1/flavors => generated 364 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 04:51:43.462713 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi [None req-16e211dd-f6fc-4c8c-bdf9-8092040c17b6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=83290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 04:51:43.499408 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: INFO nova.api.openstack.requestlog [None req-16e211dd-f6fc-4c8c-bdf9-8092040c17b6 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.040457 Feb 19 04:51:43.499998 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: [pid: 83290|app: 0|req: 9/16] 10.222.0.47 () {62 vars in 1236 bytes} [Fri Feb 19 04:51:43 2021] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 19 04:51:43.511724 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi [None req-66f4e683-fbc2-43e5-bb48-0c1063683547 admin admin] Calling method '>' {{(pid=83291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 04:51:43.527904 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: INFO nova.api.openstack.requestlog [None req-66f4e683-fbc2-43e5-bb48-0c1063683547 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.019471 Feb 19 04:51:43.528640 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: [pid: 83291|app: 0|req: 8/17] 10.222.0.47 () {58 vars in 1183 bytes} [Fri Feb 19 04:51:43 2021] GET /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Feb 19 04:51:46.148808 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi [None req-add2797d-9d28-4172-853a-0c6328a5e66e admin admin] Calling method '>' {{(pid=83290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 04:51:46.169762 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: INFO nova.api.openstack.requestlog [None req-add2797d-9d28-4172-853a-0c6328a5e66e admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/detail" status: 200 len: 1786 microversion: 2.1 time: 0.079228 Feb 19 04:51:46.170374 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: [pid: 83290|app: 0|req: 10/18] 10.222.0.47 () {58 vars in 1150 bytes} [Fri Feb 19 04:51:46 2021] GET /compute/v2.1/flavors/detail => generated 1786 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 04:51:48.830257 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi [None req-b334408f-92c2-4e87-9a8d-7fe0fea9b9eb admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.tiny", "ram": 512, "vcpus": 1, "disk": 1, "id": "1", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=83291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 04:51:48.854125 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: INFO nova.api.openstack.requestlog [None req-b334408f-92c2-4e87-9a8d-7fe0fea9b9eb admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 362 microversion: 2.1 time: 0.083100 Feb 19 04:51:48.854761 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: [pid: 83291|app: 0|req: 9/19] 10.222.0.47 () {62 vars in 1183 bytes} [Fri Feb 19 04:51:48 2021] POST /compute/v2.1/flavors => generated 362 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 04:51:48.867238 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi [None req-a39dd894-8509-4254-b4da-4e56391ee10c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=83290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 04:51:48.907604 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: INFO nova.api.openstack.requestlog [None req-a39dd894-8509-4254-b4da-4e56391ee10c admin admin] 10.222.0.47 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.044553 Feb 19 04:51:48.908247 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: [pid: 83290|app: 0|req: 11/20] 10.222.0.47 () {62 vars in 1233 bytes} [Fri Feb 19 04:51:48 2021] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 19 04:51:48.919106 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi [None req-d02e7910-aac1-4c31-b26d-9b37335b048a admin admin] Calling method '>' {{(pid=83291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 04:51:48.934858 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: INFO nova.api.openstack.requestlog [None req-d02e7910-aac1-4c31-b26d-9b37335b048a admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.020239 Feb 19 04:51:48.935451 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: [pid: 83291|app: 0|req: 10/21] 10.222.0.47 () {58 vars in 1180 bytes} [Fri Feb 19 04:51:48 2021] GET /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 19 04:51:51.546293 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi [None req-27bcd8a2-be49-420c-9427-3ff9495930ea admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.small", "ram": 2048, "vcpus": 1, "disk": 20, "id": "2", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=83290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 04:51:51.570522 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: INFO nova.api.openstack.requestlog [None req-27bcd8a2-be49-420c-9427-3ff9495930ea admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 365 microversion: 2.1 time: 0.085795 Feb 19 04:51:51.571176 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: [pid: 83290|app: 0|req: 12/22] 10.222.0.47 () {62 vars in 1183 bytes} [Fri Feb 19 04:51:51 2021] POST /compute/v2.1/flavors => generated 365 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 04:51:51.583321 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi [None req-36fe6a86-2a36-452c-a4a8-685b55010a62 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=83291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 04:51:51.623762 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: INFO nova.api.openstack.requestlog [None req-36fe6a86-2a36-452c-a4a8-685b55010a62 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.044174 Feb 19 04:51:51.624333 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: [pid: 83291|app: 0|req: 11/23] 10.222.0.47 () {62 vars in 1233 bytes} [Fri Feb 19 04:51:51 2021] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 19 04:51:51.634939 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi [None req-263dc3e0-b7c7-4f98-a302-e08d363a3b54 admin admin] Calling method '>' {{(pid=83290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 04:51:51.651168 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: INFO nova.api.openstack.requestlog [None req-263dc3e0-b7c7-4f98-a302-e08d363a3b54 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.020077 Feb 19 04:51:51.651793 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: [pid: 83290|app: 0|req: 13/24] 10.222.0.47 () {58 vars in 1180 bytes} [Fri Feb 19 04:51:51 2021] GET /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 19 04:51:54.272315 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi [None req-bd52e27a-e14d-4f0b-be26-02e4b4a335fa admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.medium", "ram": 4096, "vcpus": 2, "disk": 40, "id": "3", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=83291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 04:51:54.296350 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: INFO nova.api.openstack.requestlog [None req-bd52e27a-e14d-4f0b-be26-02e4b4a335fa admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 366 microversion: 2.1 time: 0.083634 Feb 19 04:51:54.296997 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: [pid: 83291|app: 0|req: 12/25] 10.222.0.47 () {62 vars in 1183 bytes} [Fri Feb 19 04:51:54 2021] POST /compute/v2.1/flavors => generated 366 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 04:51:54.308088 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi [None req-d2aeebf6-aef9-4e8e-bb4a-38258d1dde30 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=83290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 04:51:54.347283 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: INFO nova.api.openstack.requestlog [None req-d2aeebf6-aef9-4e8e-bb4a-38258d1dde30 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.043096 Feb 19 04:51:54.347963 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: [pid: 83290|app: 0|req: 14/26] 10.222.0.47 () {62 vars in 1233 bytes} [Fri Feb 19 04:51:54 2021] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 19 04:51:54.358288 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi [None req-77fd7690-bbd3-4967-af52-a9381ef46cc2 admin admin] Calling method '>' {{(pid=83291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 04:51:54.373955 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: INFO nova.api.openstack.requestlog [None req-77fd7690-bbd3-4967-af52-a9381ef46cc2 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.019644 Feb 19 04:51:54.374540 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: [pid: 83291|app: 0|req: 13/27] 10.222.0.47 () {58 vars in 1180 bytes} [Fri Feb 19 04:51:54 2021] GET /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 19 04:51:57.102511 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi [None req-7d363442-fd5c-4d86-9cd8-664e9edc1d10 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.large", "ram": 8192, "vcpus": 4, "disk": 80, "id": "4", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=83290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 04:51:57.125688 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: INFO nova.api.openstack.requestlog [None req-7d363442-fd5c-4d86-9cd8-664e9edc1d10 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 365 microversion: 2.1 time: 0.078303 Feb 19 04:51:57.126405 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: [pid: 83290|app: 0|req: 15/28] 10.222.0.47 () {62 vars in 1183 bytes} [Fri Feb 19 04:51:57 2021] POST /compute/v2.1/flavors => generated 365 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 04:51:57.137692 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi [None req-2a4b705b-96df-448b-bfb7-a4a15810118b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=83291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 04:51:57.174631 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: INFO nova.api.openstack.requestlog [None req-2a4b705b-96df-448b-bfb7-a4a15810118b admin admin] 10.222.0.47 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.040846 Feb 19 04:51:57.175193 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: [pid: 83291|app: 0|req: 14/29] 10.222.0.47 () {62 vars in 1233 bytes} [Fri Feb 19 04:51:57 2021] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 19 04:51:57.185864 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi [None req-df7b4d56-0703-46f0-bf1c-33540ae72dc0 admin admin] Calling method '>' {{(pid=83290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 04:51:57.201594 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: INFO nova.api.openstack.requestlog [None req-df7b4d56-0703-46f0-bf1c-33540ae72dc0 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.020080 Feb 19 04:51:57.202170 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: [pid: 83290|app: 0|req: 16/30] 10.222.0.47 () {58 vars in 1180 bytes} [Fri Feb 19 04:51:57 2021] GET /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 19 04:51:59.836018 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi [None req-02b1f9fb-5556-4b05-bc55-ea575ea34336 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.xlarge", "ram": 16384, "vcpus": 8, "disk": 160, "id": "5", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=83291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 04:51:59.860720 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: INFO nova.api.openstack.requestlog [None req-02b1f9fb-5556-4b05-bc55-ea575ea34336 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 368 microversion: 2.1 time: 0.084548 Feb 19 04:51:59.861354 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: [pid: 83291|app: 0|req: 15/31] 10.222.0.47 () {62 vars in 1183 bytes} [Fri Feb 19 04:51:59 2021] POST /compute/v2.1/flavors => generated 368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 04:51:59.874997 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi [None req-df9ff293-2bb9-4d92-bbf8-9fdd6434a966 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=83290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 04:51:59.918787 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: INFO nova.api.openstack.requestlog [None req-df9ff293-2bb9-4d92-bbf8-9fdd6434a966 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.049188 Feb 19 04:51:59.919378 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: [pid: 83290|app: 0|req: 17/32] 10.222.0.47 () {62 vars in 1233 bytes} [Fri Feb 19 04:51:59 2021] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 19 04:51:59.929742 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi [None req-3e3d68bc-3546-4593-b2ec-c6a86bb77399 admin admin] Calling method '>' {{(pid=83291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 04:51:59.945816 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: INFO nova.api.openstack.requestlog [None req-3e3d68bc-3546-4593-b2ec-c6a86bb77399 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.019935 Feb 19 04:51:59.946634 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: [pid: 83291|app: 0|req: 16/33] 10.222.0.47 () {58 vars in 1180 bytes} [Fri Feb 19 04:51:59 2021] GET /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 19 04:53:13.472882 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi [None req-5c686539-43fb-4e16-bec7-e6600bdd9532 admin admin] Calling method '>' {{(pid=83290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 04:53:13.498283 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: INFO nova.api.openstack.requestlog [None req-5c686539-43fb-4e16-bec7-e6600bdd9532 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/detail" status: 200 len: 3562 microversion: 2.1 time: 0.078796 Feb 19 04:53:13.498881 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: [pid: 83290|app: 0|req: 18/34] 10.222.0.47 () {58 vars in 1150 bytes} [Fri Feb 19 04:53:13 2021] GET /compute/v2.1/flavors/detail => generated 3562 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 04:53:15.193877 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi [None req-3e3d68bc-3546-4593-b2ec-c6a86bb77399 admin admin] Calling method '>' {{(pid=83291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 04:53:15.195002 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: INFO nova.api.openstack.requestlog [None req-3e3d68bc-3546-4593-b2ec-c6a86bb77399 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001550 Feb 19 04:53:15.195469 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: [pid: 83291|app: 0|req: 17/35] 10.222.0.47 () {56 vars in 1065 bytes} [Fri Feb 19 04:53:15 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 04:53:15.388049 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi [None req-c5d3b6a6-7d2e-4a0c-adaa-f2649baa5a9b admin admin] Calling method '>' {{(pid=83290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 04:53:15.403097 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: INFO nova.api.openstack.wsgi [None req-c5d3b6a6-7d2e-4a0c-adaa-f2649baa5a9b admin admin] HTTP exception thrown: Flavor 42 could not be found. Feb 19 04:53:15.403768 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi [None req-c5d3b6a6-7d2e-4a0c-adaa-f2649baa5a9b admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=83290) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 19 04:53:15.404632 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: INFO nova.api.openstack.requestlog [None req-c5d3b6a6-7d2e-4a0c-adaa-f2649baa5a9b admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.87 time: 0.073270 Feb 19 04:53:15.405202 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: [pid: 83290|app: 0|req: 19/36] 10.222.0.47 () {60 vars in 1181 bytes} [Fri Feb 19 04:53:15 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Feb 19 04:53:15.416151 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi [None req-b4b9c78f-6278-4100-8bca-baf1048bbc7e admin admin] Calling method '>' {{(pid=83291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 04:53:15.439184 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: INFO nova.api.openstack.requestlog [None req-b4b9c78f-6278-4100-8bca-baf1048bbc7e admin admin] 10.222.0.47 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.87 time: 0.026842 Feb 19 04:53:15.439854 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: [pid: 83291|app: 0|req: 18/37] 10.222.0.47 () {60 vars in 1201 bytes} [Fri Feb 19 04:53:15 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 04:53:15.451891 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi [None req-b669802b-6545-4231-8c42-264648c5fcbf admin admin] Calling method '>' {{(pid=83290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 04:53:15.474155 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: INFO nova.api.openstack.requestlog [None req-b669802b-6545-4231-8c42-264648c5fcbf admin admin] 10.222.0.47 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.87 time: 0.027191 Feb 19 04:53:15.474734 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: [pid: 83290|app: 0|req: 20/38] 10.222.0.47 () {60 vars in 1201 bytes} [Fri Feb 19 04:53:15 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 04:53:15.485261 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi [None req-ca648c3d-7807-4d13-a93f-5cc9fabdb5d1 admin admin] Calling method '>' {{(pid=83291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 04:53:15.501975 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: INFO nova.api.openstack.wsgi [None req-ca648c3d-7807-4d13-a93f-5cc9fabdb5d1 admin admin] HTTP exception thrown: Flavor 42 could not be found. Feb 19 04:53:15.502615 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi [None req-ca648c3d-7807-4d13-a93f-5cc9fabdb5d1 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=83291) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 19 04:53:15.503518 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: INFO nova.api.openstack.requestlog [None req-ca648c3d-7807-4d13-a93f-5cc9fabdb5d1 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.87 time: 0.022205 Feb 19 04:53:15.504079 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: [pid: 83291|app: 0|req: 19/39] 10.222.0.47 () {60 vars in 1181 bytes} [Fri Feb 19 04:53:15 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 23 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Feb 19 04:53:17.085472 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi [None req-b669802b-6545-4231-8c42-264648c5fcbf admin admin] Calling method '>' {{(pid=83290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 04:53:17.086536 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: INFO nova.api.openstack.requestlog [None req-b669802b-6545-4231-8c42-264648c5fcbf admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001530 Feb 19 04:53:17.086967 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: [pid: 83290|app: 0|req: 21/40] 10.222.0.47 () {56 vars in 1065 bytes} [Fri Feb 19 04:53:17 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 04:53:17.276016 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi [None req-d9fb0a32-671f-43c8-bd47-33913c8ea22b admin admin] Calling method '>' {{(pid=83291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 04:53:17.289180 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: INFO nova.api.openstack.wsgi [None req-d9fb0a32-671f-43c8-bd47-33913c8ea22b admin admin] HTTP exception thrown: Flavor 84 could not be found. Feb 19 04:53:17.289789 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi [None req-d9fb0a32-671f-43c8-bd47-33913c8ea22b admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=83291) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 19 04:53:17.290626 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: INFO nova.api.openstack.requestlog [None req-d9fb0a32-671f-43c8-bd47-33913c8ea22b admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.87 time: 0.069150 Feb 19 04:53:17.291178 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: [pid: 83291|app: 0|req: 20/41] 10.222.0.47 () {60 vars in 1181 bytes} [Fri Feb 19 04:53:17 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Feb 19 04:53:17.301735 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi [None req-e527e3d9-b23a-4df0-ae3e-8274adbabf29 admin admin] Calling method '>' {{(pid=83290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 04:53:17.324316 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: INFO nova.api.openstack.requestlog [None req-e527e3d9-b23a-4df0-ae3e-8274adbabf29 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.87 time: 0.026258 Feb 19 04:53:17.324918 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: [pid: 83290|app: 0|req: 22/42] 10.222.0.47 () {60 vars in 1201 bytes} [Fri Feb 19 04:53:17 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 04:53:17.335646 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi [None req-6d7b2430-c73f-44ff-bc55-dcb3a26a9769 admin admin] Calling method '>' {{(pid=83291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 04:53:17.357908 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: INFO nova.api.openstack.requestlog [None req-6d7b2430-c73f-44ff-bc55-dcb3a26a9769 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.87 time: 0.026117 Feb 19 04:53:17.358512 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: [pid: 83291|app: 0|req: 21/43] 10.222.0.47 () {60 vars in 1201 bytes} [Fri Feb 19 04:53:17 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 04:53:17.369000 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi [None req-cb8809dc-f150-49d7-bd47-be3512f7d1da admin admin] Calling method '>' {{(pid=83290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 04:53:17.382747 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: INFO nova.api.openstack.wsgi [None req-cb8809dc-f150-49d7-bd47-be3512f7d1da admin admin] HTTP exception thrown: Flavor 84 could not be found. Feb 19 04:53:17.383404 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi [None req-cb8809dc-f150-49d7-bd47-be3512f7d1da admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=83290) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 19 04:53:17.384256 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: INFO nova.api.openstack.requestlog [None req-cb8809dc-f150-49d7-bd47-be3512f7d1da admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.87 time: 0.019147 Feb 19 04:53:17.384818 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: [pid: 83290|app: 0|req: 23/44] 10.222.0.47 () {60 vars in 1181 bytes} [Fri Feb 19 04:53:17 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Feb 19 04:53:18.962128 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi [None req-6d7b2430-c73f-44ff-bc55-dcb3a26a9769 admin admin] Calling method '>' {{(pid=83291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 04:53:18.963349 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: INFO nova.api.openstack.requestlog [None req-6d7b2430-c73f-44ff-bc55-dcb3a26a9769 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001626 Feb 19 04:53:18.963892 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: [pid: 83291|app: 0|req: 22/45] 10.222.0.47 () {56 vars in 1065 bytes} [Fri Feb 19 04:53:18 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 04:53:19.148626 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi [None req-c7f901a2-f6ce-4044-86f7-d92bf8c2bdde admin admin] Calling method '>' {{(pid=83290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 04:53:19.161811 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: INFO nova.api.openstack.wsgi [None req-c7f901a2-f6ce-4044-86f7-d92bf8c2bdde admin admin] HTTP exception thrown: Flavor 451 could not be found. Feb 19 04:53:19.162439 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi [None req-c7f901a2-f6ce-4044-86f7-d92bf8c2bdde admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=83290) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 19 04:53:19.163297 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: INFO nova.api.openstack.requestlog [None req-c7f901a2-f6ce-4044-86f7-d92bf8c2bdde admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.87 time: 0.069612 Feb 19 04:53:19.163966 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: [pid: 83290|app: 0|req: 24/46] 10.222.0.47 () {60 vars in 1184 bytes} [Fri Feb 19 04:53:19 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Feb 19 04:53:19.174276 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi [None req-5dc980b6-05c4-4c3c-93b2-1fa60d3f02aa admin admin] Calling method '>' {{(pid=83291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 04:53:19.196563 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: INFO nova.api.openstack.requestlog [None req-5dc980b6-05c4-4c3c-93b2-1fa60d3f02aa admin admin] 10.222.0.47 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.87 time: 0.026125 Feb 19 04:53:19.197158 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: [pid: 83291|app: 0|req: 23/47] 10.222.0.47 () {60 vars in 1201 bytes} [Fri Feb 19 04:53:19 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 04:53:19.208550 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi [None req-dfd64ea2-642c-4715-b0fa-d36b60e33284 admin admin] Calling method '>' {{(pid=83290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 04:53:19.230470 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: INFO nova.api.openstack.requestlog [None req-dfd64ea2-642c-4715-b0fa-d36b60e33284 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.87 time: 0.025686 Feb 19 04:53:19.231067 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: [pid: 83290|app: 0|req: 25/48] 10.222.0.47 () {60 vars in 1201 bytes} [Fri Feb 19 04:53:19 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 04:53:19.241631 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi [None req-f9572cb2-7deb-4359-8eba-f7d7ff952d0c admin admin] Calling method '>' {{(pid=83291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 04:53:19.254928 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: INFO nova.api.openstack.wsgi [None req-f9572cb2-7deb-4359-8eba-f7d7ff952d0c admin admin] HTTP exception thrown: Flavor 451 could not be found. Feb 19 04:53:19.255565 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi [None req-f9572cb2-7deb-4359-8eba-f7d7ff952d0c admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=83291) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 19 04:53:19.256654 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: INFO nova.api.openstack.requestlog [None req-f9572cb2-7deb-4359-8eba-f7d7ff952d0c admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.87 time: 0.018858 Feb 19 04:53:19.257201 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: [pid: 83291|app: 0|req: 24/49] 10.222.0.47 () {60 vars in 1184 bytes} [Fri Feb 19 04:53:19 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Feb 19 04:53:20.862020 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi [None req-dfd64ea2-642c-4715-b0fa-d36b60e33284 admin admin] Calling method '>' {{(pid=83290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 04:53:20.863097 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: INFO nova.api.openstack.requestlog [None req-dfd64ea2-642c-4715-b0fa-d36b60e33284 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001523 Feb 19 04:53:20.863559 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: [pid: 83290|app: 0|req: 26/50] 10.222.0.47 () {56 vars in 1065 bytes} [Fri Feb 19 04:53:20 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 04:53:21.059385 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi [None req-2e714ae9-5490-42a4-a7f3-7c8d339958a4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=83291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 04:53:21.082753 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: INFO nova.api.openstack.requestlog [None req-2e714ae9-5490-42a4-a7f3-7c8d339958a4 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.87 time: 0.079063 Feb 19 04:53:21.083354 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: [pid: 83291|app: 0|req: 25/51] 10.222.0.47 () {64 vars in 1226 bytes} [Fri Feb 19 04:53:21 2021] POST /compute/v2.1/flavors => generated 404 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 19 04:53:22.662221 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi [None req-dfd64ea2-642c-4715-b0fa-d36b60e33284 admin admin] Calling method '>' {{(pid=83290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 04:53:22.663280 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: INFO nova.api.openstack.requestlog [None req-dfd64ea2-642c-4715-b0fa-d36b60e33284 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001514 Feb 19 04:53:22.663749 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: [pid: 83290|app: 0|req: 27/52] 10.222.0.47 () {56 vars in 1065 bytes} [Fri Feb 19 04:53:22 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 04:53:22.853186 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi [None req-b449cbbc-4e65-4e0d-9afb-586b8649ae96 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=83291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 04:53:22.877944 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: INFO nova.api.openstack.requestlog [None req-b449cbbc-4e65-4e0d-9afb-586b8649ae96 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.87 time: 0.081159 Feb 19 04:53:22.878538 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: [pid: 83291|app: 0|req: 26/53] 10.222.0.47 () {64 vars in 1226 bytes} [Fri Feb 19 04:53:22 2021] POST /compute/v2.1/flavors => generated 405 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 19 04:53:24.461003 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi [None req-dfd64ea2-642c-4715-b0fa-d36b60e33284 admin admin] Calling method '>' {{(pid=83290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 04:53:24.462101 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: INFO nova.api.openstack.requestlog [None req-dfd64ea2-642c-4715-b0fa-d36b60e33284 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001599 Feb 19 04:53:24.462538 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: [pid: 83290|app: 0|req: 28/54] 10.222.0.47 () {56 vars in 1065 bytes} [Fri Feb 19 04:53:24 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 04:53:24.651676 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi [None req-bb8af251-06e4-4c28-9afa-ad6695308300 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=83291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 04:53:24.687490 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: INFO nova.api.openstack.requestlog [None req-bb8af251-06e4-4c28-9afa-ad6695308300 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.87 time: 0.092199 Feb 19 04:53:24.688016 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: [pid: 83291|app: 0|req: 27/55] 10.222.0.47 () {64 vars in 1226 bytes} [Fri Feb 19 04:53:24 2021] POST /compute/v2.1/flavors => generated 407 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 19 04:53:26.283043 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi [None req-dfd64ea2-642c-4715-b0fa-d36b60e33284 admin admin] Calling method '>' {{(pid=83290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 04:53:26.284166 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: INFO nova.api.openstack.requestlog [None req-dfd64ea2-642c-4715-b0fa-d36b60e33284 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001569 Feb 19 04:53:26.284604 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: [pid: 83290|app: 0|req: 29/56] 10.222.0.47 () {56 vars in 1065 bytes} [Fri Feb 19 04:53:26 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 04:53:26.473286 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi [None req-0ee52b62-5ef4-433f-80c9-5721a17b72e4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=83291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 04:53:26.497736 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: INFO nova.api.openstack.requestlog [None req-0ee52b62-5ef4-433f-80c9-5721a17b72e4 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.87 time: 0.079146 Feb 19 04:53:26.498245 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: [pid: 83291|app: 0|req: 28/57] 10.222.0.47 () {64 vars in 1226 bytes} [Fri Feb 19 04:53:26 2021] POST /compute/v2.1/flavors => generated 409 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 19 04:53:28.096315 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi [None req-dfd64ea2-642c-4715-b0fa-d36b60e33284 admin admin] Calling method '>' {{(pid=83290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 04:53:28.097384 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: INFO nova.api.openstack.requestlog [None req-dfd64ea2-642c-4715-b0fa-d36b60e33284 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001544 Feb 19 04:53:28.097821 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: [pid: 83290|app: 0|req: 30/58] 10.222.0.47 () {56 vars in 1065 bytes} [Fri Feb 19 04:53:28 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 19 04:53:28.288863 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi [None req-bcf4e9c6-eff6-4fcb-a54e-11f27458f94f admin admin] Calling method '>' {{(pid=83291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 04:53:28.326973 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: INFO nova.api.openstack.requestlog [None req-bcf4e9c6-eff6-4fcb-a54e-11f27458f94f admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.87 time: 0.098492 Feb 19 04:53:28.327653 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: [pid: 83291|app: 0|req: 29/59] 10.222.0.47 () {60 vars in 1193 bytes} [Fri Feb 19 04:53:28 2021] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 04:54:19.953797 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi [None req-dfd64ea2-642c-4715-b0fa-d36b60e33284 admin admin] Calling method '>' {{(pid=83290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 04:54:19.954874 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: INFO nova.api.openstack.requestlog [None req-dfd64ea2-642c-4715-b0fa-d36b60e33284 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001535 Feb 19 04:54:19.955319 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: [pid: 83290|app: 0|req: 31/60] 10.222.0.47 () {56 vars in 1065 bytes} [Fri Feb 19 04:54:19 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 04:54:20.144928 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi [None req-f27bc3ca-821e-4ff2-821a-164052162210 admin admin] Calling method '>' {{(pid=83291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 04:54:20.174119 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: INFO nova.api.openstack.requestlog [None req-f27bc3ca-821e-4ff2-821a-164052162210 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.87 time: 0.083589 Feb 19 04:54:20.174703 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: [pid: 83291|app: 0|req: 30/61] 10.222.0.47 () {60 vars in 1193 bytes} [Fri Feb 19 04:54:20 2021] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 04:55:41.250557 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi [None req-408c921e-252f-4ebc-8feb-33875b6ddd34 tempest-verify_tempest_config-948760762 tempest-verify_tempest_config-948760762-project] Calling method '>' {{(pid=83290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 04:55:41.252596 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: INFO nova.api.openstack.requestlog [None req-408c921e-252f-4ebc-8feb-33875b6ddd34 tempest-verify_tempest_config-948760762 tempest-verify_tempest_config-948760762-project] 10.222.0.47 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.127493 Feb 19 04:55:41.253215 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: [pid: 83290|app: 0|req: 32/62] 10.222.0.47 () {58 vars in 1124 bytes} [Fri Feb 19 04:55:41 2021] GET /compute/v2.1/extensions => generated 22700 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 19 04:57:16.506248 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi [None req-f27bc3ca-821e-4ff2-821a-164052162210 admin admin] Calling method '>' {{(pid=83291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 04:57:16.507360 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: INFO nova.api.openstack.requestlog [None req-f27bc3ca-821e-4ff2-821a-164052162210 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001541 Feb 19 04:57:16.508177 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: [pid: 83291|app: 0|req: 31/63] 10.222.0.47 () {56 vars in 1065 bytes} [Fri Feb 19 04:57:16 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 04:57:16.770744 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi [None req-520e890e-2df7-49bf-ba9b-9a9daffdc784 admin admin] Calling method '>' {{(pid=83290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 04:57:16.772018 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 04:57:16.772018 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: warnings.warn(msg) Feb 19 04:57:16.774178 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG oslo_concurrency.lockutils [None req-520e890e-2df7-49bf-ba9b-9a9daffdc784 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=83290) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 04:57:16.774668 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG oslo_concurrency.lockutils [None req-520e890e-2df7-49bf-ba9b-9a9daffdc784 admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=83290) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 04:57:16.775546 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG oslo_concurrency.lockutils [None req-520e890e-2df7-49bf-ba9b-9a9daffdc784 admin admin] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=83290) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 04:57:16.776020 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG oslo_concurrency.lockutils [None req-520e890e-2df7-49bf-ba9b-9a9daffdc784 admin admin] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=83290) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 04:57:16.809517 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: INFO nova.api.openstack.requestlog [None req-520e890e-2df7-49bf-ba9b-9a9daffdc784 admin admin] 10.222.0.47 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.87 time: 0.167647 Feb 19 04:57:16.810134 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: [pid: 83290|app: 0|req: 33/64] 10.222.0.47 () {60 vars in 1184 bytes} [Fri Feb 19 04:57:16 2021] GET /compute/v2.1/os-services => generated 791 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 19 04:57:18.380006 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi [None req-f27bc3ca-821e-4ff2-821a-164052162210 admin admin] Calling method '>' {{(pid=83291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 04:57:18.381061 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: INFO nova.api.openstack.requestlog [None req-f27bc3ca-821e-4ff2-821a-164052162210 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001537 Feb 19 04:57:18.381495 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: [pid: 83291|app: 0|req: 32/65] 10.222.0.47 () {56 vars in 1065 bytes} [Fri Feb 19 04:57:18 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 04:57:18.564813 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi [None req-21e6a2af-f820-4bc2-ba02-2ce19871f36f admin admin] Calling method '>' {{(pid=83290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 04:57:18.566072 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 04:57:18.566072 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: warnings.warn(msg) Feb 19 04:57:18.567667 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG oslo_concurrency.lockutils [None req-21e6a2af-f820-4bc2-ba02-2ce19871f36f admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=83290) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 04:57:18.568164 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG oslo_concurrency.lockutils [None req-21e6a2af-f820-4bc2-ba02-2ce19871f36f admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=83290) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 04:57:18.568999 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG oslo_concurrency.lockutils [None req-21e6a2af-f820-4bc2-ba02-2ce19871f36f admin admin] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=83290) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 04:57:18.569535 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG oslo_concurrency.lockutils [None req-21e6a2af-f820-4bc2-ba02-2ce19871f36f admin admin] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=83290) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 04:57:18.594624 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: INFO nova.api.openstack.requestlog [None req-21e6a2af-f820-4bc2-ba02-2ce19871f36f admin admin] 10.222.0.47 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.87 time: 0.085330 Feb 19 04:57:18.595214 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: [pid: 83290|app: 0|req: 34/66] 10.222.0.47 () {60 vars in 1184 bytes} [Fri Feb 19 04:57:18 2021] GET /compute/v2.1/os-services => generated 791 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 19 04:57:30.621198 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi [None req-f27bc3ca-821e-4ff2-821a-164052162210 admin admin] Calling method '>' {{(pid=83291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 04:57:30.622267 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: INFO nova.api.openstack.requestlog [None req-f27bc3ca-821e-4ff2-821a-164052162210 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001528 Feb 19 04:57:30.622701 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: [pid: 83291|app: 0|req: 33/67] 10.222.0.47 () {56 vars in 1065 bytes} [Fri Feb 19 04:57:30 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 04:57:30.809013 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi [None req-f3c32994-5c4c-41b3-afa3-7c8f51abc55d admin admin] Calling method '>' {{(pid=83290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 04:57:30.810283 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 04:57:30.810283 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: warnings.warn(msg) Feb 19 04:57:30.811976 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG oslo_concurrency.lockutils [None req-f3c32994-5c4c-41b3-afa3-7c8f51abc55d admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=83290) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 04:57:30.812527 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG oslo_concurrency.lockutils [None req-f3c32994-5c4c-41b3-afa3-7c8f51abc55d admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=83290) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 04:57:30.813370 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG oslo_concurrency.lockutils [None req-f3c32994-5c4c-41b3-afa3-7c8f51abc55d admin admin] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=83290) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 04:57:30.813852 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG oslo_concurrency.lockutils [None req-f3c32994-5c4c-41b3-afa3-7c8f51abc55d admin admin] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=83290) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 04:57:30.845905 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: INFO nova.api.openstack.requestlog [None req-f3c32994-5c4c-41b3-afa3-7c8f51abc55d admin admin] 10.222.0.47 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.87 time: 0.091828 Feb 19 04:57:30.846574 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: [pid: 83290|app: 0|req: 35/68] 10.222.0.47 () {60 vars in 1184 bytes} [Fri Feb 19 04:57:30 2021] GET /compute/v2.1/os-services => generated 1035 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 04:57:32.461394 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi [None req-f27bc3ca-821e-4ff2-821a-164052162210 admin admin] Calling method '>' {{(pid=83291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 04:57:32.462459 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: INFO nova.api.openstack.requestlog [None req-f27bc3ca-821e-4ff2-821a-164052162210 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001531 Feb 19 04:57:32.462898 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: [pid: 83291|app: 0|req: 34/69] 10.222.0.47 () {56 vars in 1065 bytes} [Fri Feb 19 04:57:32 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 04:57:32.651305 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG nova.api.openstack.wsgi [None req-c2d22656-2068-4521-9499-289dff971804 admin admin] Calling method '>' {{(pid=83290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 04:57:32.652658 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 04:57:32.652658 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: warnings.warn(msg) Feb 19 04:57:32.654265 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG oslo_concurrency.lockutils [None req-c2d22656-2068-4521-9499-289dff971804 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=83290) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 04:57:32.654759 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG oslo_concurrency.lockutils [None req-c2d22656-2068-4521-9499-289dff971804 admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=83290) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 04:57:32.655681 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG oslo_concurrency.lockutils [None req-c2d22656-2068-4521-9499-289dff971804 admin admin] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=83290) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 04:57:32.656161 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: DEBUG oslo_concurrency.lockutils [None req-c2d22656-2068-4521-9499-289dff971804 admin admin] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=83290) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 04:57:32.684341 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: INFO nova.api.openstack.requestlog [None req-c2d22656-2068-4521-9499-289dff971804 admin admin] 10.222.0.47 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.87 time: 0.091830 Feb 19 04:57:32.684878 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: [pid: 83290|app: 0|req: 36/70] 10.222.0.47 () {60 vars in 1184 bytes} [Fri Feb 19 04:57:32 2021] GET /compute/v2.1/os-services => generated 1035 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 04:58:32.292455 dv-cinder-776422-3-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Feb 19 04:58:32.293173 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: Fri Feb 19 04:58:32 2021 - graceful shutdown triggered... Feb 19 04:58:32.293619 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: Gracefully killing worker 1 (pid: 83290)... Feb 19 04:58:32.293711 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: Gracefully killing worker 2 (pid: 83291)... Feb 19 04:58:33.293801 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: worker 1 buried after 1 seconds Feb 19 04:58:33.293801 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: worker 2 buried after 1 seconds Feb 19 04:58:33.293801 dv-cinder-776422-3-iscsi devstack@n-api.service[83289]: goodbye to uWSGI. Feb 19 04:58:33.295436 dv-cinder-776422-3-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Feb 19 04:58:33.297134 dv-cinder-776422-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Feb 19 04:58:33.305490 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Feb 19 04:58:33.307588 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: *** Starting uWSGI 2.0.15-debian (64bit) on [Fri Feb 19 04:58:33 2021] *** Feb 19 04:58:33.307588 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: compiled with version: 7.3.0 on 28 September 2018 15:41:15 Feb 19 04:58:33.307588 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: os: Linux-4.15.0-55-generic #60-Ubuntu SMP Tue Jul 2 18:22:20 UTC 2019 Feb 19 04:58:33.307588 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: nodename: dv-cinder-776422-3-iscsi Feb 19 04:58:33.307588 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: machine: x86_64 Feb 19 04:58:33.307588 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: clock source: unix Feb 19 04:58:33.307588 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: pcre jit disabled Feb 19 04:58:33.307588 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: detected number of CPU cores: 4 Feb 19 04:58:33.307588 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: current working directory: / Feb 19 04:58:33.307588 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: detected binary path: /usr/bin/uwsgi-core Feb 19 04:58:33.307588 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: dropping root privileges as early as possible Feb 19 04:58:33.307588 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: your processes number limit is 47843 Feb 19 04:58:33.308704 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: your memory page size is 4096 bytes Feb 19 04:58:33.308704 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: detected max file descriptor number: 2048 Feb 19 04:58:33.308704 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: lock engine: pthread robust mutexes Feb 19 04:58:33.308704 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: thunder lock: enabled Feb 19 04:58:33.308704 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Feb 19 04:58:33.308704 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: dropping root privileges after socket binding Feb 19 04:58:33.308704 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: Python version: 3.6.9 (default, Oct 8 2020, 12:12:24) [GCC 8.4.0] Feb 19 04:58:33.354066 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: Python main interpreter initialized at 0x55a8e117e9c0 Feb 19 04:58:33.354066 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: dropping root privileges after plugin initialization Feb 19 04:58:33.354066 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: python threads support enabled Feb 19 04:58:33.354066 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: your server socket listen backlog is limited to 100 connections Feb 19 04:58:33.354066 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: your mercy for graceful operations on workers is 90 seconds Feb 19 04:58:33.354544 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: mapped 402621 bytes (393 KB) for 2 cores Feb 19 04:58:33.354544 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: *** Operational MODE: preforking *** Feb 19 04:58:33.354756 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: dropping root privileges after application loading Feb 19 04:58:33.354756 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: *** uWSGI is running in multiple interpreter mode *** Feb 19 04:58:33.354756 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: spawned uWSGI master process (pid: 98151) Feb 19 04:58:33.356516 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: spawned uWSGI worker 1 (pid: 98153, cores: 1) Feb 19 04:58:33.356516 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: spawned uWSGI worker 2 (pid: 98154, cores: 1) Feb 19 04:58:33.356516 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Feb 19 04:58:33.354931 dv-cinder-776422-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Feb 19 04:58:37.961117 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2567}} Feb 19 04:58:37.962098 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2568}} Feb 19 04:58:37.963945 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2569}} Feb 19 04:58:37.964617 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2571}} Feb 19 04:58:37.965110 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2572}} Feb 19 04:58:37.965775 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:37.966342 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:37.966924 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:37.967513 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:37.968095 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:37.968665 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:37.969244 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:37.969812 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:37.970397 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:37.970902 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:37.971497 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:37.972094 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-776422-3-iscsi {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:37.972673 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:37.973222 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:37.973785 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:37.974361 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:37.974909 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:37.975536 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:37.976088 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:37.977519 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:37.978122 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:37.978685 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:37.979250 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:37.979891 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:37.980920 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:37.981297 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:37.981690 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:37.982060 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:37.982456 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:37.982824 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:37.983210 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-776422-3-iscsi {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:37.983620 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:37.983991 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:37.984360 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:37.984879 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:37.985243 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:37.985605 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:37.985984 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:37.986340 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:37.986711 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:37.987086 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:37.987667 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:37.988221 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:37.988603 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:37.988956 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:37.989316 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:37.989675 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:37.990049 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:37.990404 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:37.990759 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:37.991132 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:37.991516 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:37.991898 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:37.992823 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:37.993078 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2567}} Feb 19 04:58:37.993188 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:37.993362 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2568}} Feb 19 04:58:37.993464 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:37.993731 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:37.994108 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:37.994494 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:37.994857 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:37.995022 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2569}} Feb 19 04:58:37.995213 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:37.995469 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2571}} Feb 19 04:58:37.995629 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:37.995779 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2572}} Feb 19 04:58:37.995941 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:37.996206 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:37.996383 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:37.996813 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:37.996962 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:37.997121 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:37.997284 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:37.997434 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:37.997588 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:37.997740 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:37.997890 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:37.998039 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:37.998218 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:37.998447 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:37.998606 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:37.998783 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:37.998890 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:37.999000 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:37.999107 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:37.999374 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:37.999537 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.47 {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:37.999687 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.47 {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:37.999837 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:38.000035 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:38.000190 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-776422-3-iscsi {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:38.000437 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:38.000545 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:38.000778 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:38.000884 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:38.001130 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:38.001242 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:38.001493 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:38.001607 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:38.001829 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:38.001944 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:38.002197 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:38.002308 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:38.002534 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:38.002644 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:38.002905 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:38.003151 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:38.003277 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:38.003525 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:38.003641 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:38.003871 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:38.003990 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:38.004219 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:38.004324 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:38.004560 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:38.004666 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:38.004913 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:38.005025 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:38.005255 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:38.005361 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:38.005611 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:38.005724 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:38.005951 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:38.006068 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:38.006297 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:38.006402 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:38.006642 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:38.006755 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:38.006986 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:38.007100 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-776422-3-iscsi {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:38.007368 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:38.007513 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:38.007752 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:38.008386 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:38.008900 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:38.009062 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:38.009256 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:38.009439 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:38.009588 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:38.009792 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:38.009903 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:38.010143 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:38.010256 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:38.010515 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:38.010619 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:38.010883 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:38.010996 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:38.011237 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:38.011415 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:38.011634 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:38.011751 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:38.011980 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:38.012097 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:38.012333 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:38.012444 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:38.012685 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:38.012798 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:38.013018 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:38.013130 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:38.013367 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:38.013478 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:38.013712 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:38.013823 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:38.014067 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:38.014185 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:38.014411 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:38.014515 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:38.014755 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:38.014865 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:38.015034 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:38.015147 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:38.015401 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:38.015521 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:38.015771 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:38.015881 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:38.016137 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:38.016241 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:38.016481 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:38.016586 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:38.016766 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:38.016877 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:38.017051 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:38.017155 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:38.017414 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:38.017518 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:38.017789 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:38.017904 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:38.018140 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:38.018243 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:38.018477 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:38.018581 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:38.018816 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:38.018932 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:38.019154 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:38.019258 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:38.019524 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:38.019631 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:38.019866 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:38.020060 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:38.020171 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:38.020316 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:38.020528 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:38.020683 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:38.020888 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:38.021008 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:38.021234 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:38.021338 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:38.021587 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:38.021747 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:38.021939 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:38.022140 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:38.022278 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:38.022669 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.022789 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:38.023059 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.023262 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.47 {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:38.023517 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.023684 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.47 {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:38.024037 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:38.024122 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.024430 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:38.024524 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.024796 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:38.024887 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.025148 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:38.025232 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.025504 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.025596 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:38.025865 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:38.025949 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.026214 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:38.026305 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.026541 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:38.026731 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.027058 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:38.027174 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.027452 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.027554 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:38.027836 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:38.027925 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.028108 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:38.028211 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.028403 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:38.028513 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.028882 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:38.028985 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.029070 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:38.029179 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.029531 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:38.029634 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.029860 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:38.030051 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.030216 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:38.030374 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.030521 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:38.030714 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.030866 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:38.030970 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.031170 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:38.031277 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.031543 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:38.031663 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.031888 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:38.031992 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.032233 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:38.032338 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.032577 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:38.032695 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.032920 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:38.033032 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.033266 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:38.033370 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.033610 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:38.033727 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.033954 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:38.034058 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.034319 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:38.034423 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.034683 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:38.034796 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.035026 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:38.035130 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.035392 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:38.035500 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.035738 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:38.035849 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.036081 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:38.036194 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.036444 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:38.036549 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.036790 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:38.036900 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.037132 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:38.037235 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.037479 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.037591 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:38.037817 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:38.037928 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.038159 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:38.038263 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.038649 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.038764 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:38.038967 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:38.039076 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.039203 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:38.039447 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.039592 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:38.039848 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.039961 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:38.040207 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.040354 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:38.040566 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.040697 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:38.040914 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:38.041070 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.041257 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:38.041361 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.041598 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:38.041711 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.041940 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:38.042050 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.042278 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:38.042388 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.042619 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:38.042732 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.042961 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:38.043071 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.043300 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:38.043454 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.043663 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:38.043780 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.044020 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.044132 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:38.044377 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.044487 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:38.044717 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:38.044835 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.045061 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:38.045166 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.045402 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:38.045506 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.045753 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.045864 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 04:58:38.046121 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.046226 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.046472 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.046577 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.046839 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.046952 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.047193 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.047302 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.047602 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.047717 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.047969 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.048075 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.048320 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.048425 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.048675 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.048786 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.049029 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.049135 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.049374 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.049478 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.049726 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.049844 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.050074 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.050181 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.050422 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.050526 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.050766 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.050923 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.051123 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.051237 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.051471 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.051589 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.051825 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.051938 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.052176 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.052280 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.052527 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.052632 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.052871 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.052983 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.053222 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.053327 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.053575 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.053685 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.053926 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.054030 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.054269 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.054380 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.055186 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.055304 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.055709 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.055966 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.056081 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.056342 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.056605 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.056710 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.057013 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.057119 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.057431 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.057552 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.057731 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.057843 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.058086 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.058191 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.058444 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.058555 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.058790 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.058894 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = None {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.059140 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = None {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.059245 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.059542 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.059648 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.059901 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.060075 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.060251 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.060393 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.060597 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.060681 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.060944 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.061059 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.061284 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.061386 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.061634 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.061745 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_vgpu_types = [] {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.061980 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.062118 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.062343 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.062454 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.062698 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.062815 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.063039 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.063157 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.063435 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.063544 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.063795 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.063899 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.064145 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.064257 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.064490 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.064593 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.064837 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.064940 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.065182 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.065289 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.065531 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.065642 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.065876 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.065980 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.066226 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.066337 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.066567 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.066677 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.066914 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.067018 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.067265 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.067395 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.067633 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.067742 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.067980 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.068083 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.068329 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.068439 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.068678 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.068782 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.069030 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.069147 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.069381 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.069485 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.069750 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.069860 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.070127 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.070831 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.070957 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.071073 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.071354 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.071493 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.071731 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.071865 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.072087 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.072192 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.072441 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.072551 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.072797 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.072912 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.073158 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.073263 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.073505 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.073616 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.073856 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.073972 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.074196 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.074308 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.074542 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.074645 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.074889 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.075005 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.075240 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.075395 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.075621 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.075733 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.075962 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.076067 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.076308 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.076413 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.076654 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.076764 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.077000 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.077104 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.077353 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.077475 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.077698 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.077814 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.078040 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.078145 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.078384 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.078490 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.078730 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.078847 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.079087 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.079198 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.079467 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.079591 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.079819 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.079935 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.080175 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.080287 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.080536 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.080647 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.080891 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.081004 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.081242 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.081664 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = None {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.081854 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.081979 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = None {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.082093 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.082223 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.082343 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.082599 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.082863 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.082973 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.083271 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.083408 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.083648 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.083764 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.083993 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.084223 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.084340 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_vgpu_types = [] {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.084640 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.084746 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.085014 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.085125 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.085358 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.085471 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.085732 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.085852 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.086093 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.086288 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.086495 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.086648 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.086754 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.087001 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.087114 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.087398 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.087506 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.087716 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.087821 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.088068 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.088172 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.088424 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.088538 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.088773 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.088877 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.089119 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.089223 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.089458 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.089570 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.089814 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.089924 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.090161 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.090264 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.090495 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.090612 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.090844 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.090948 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.091194 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.091298 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.091574 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.091695 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.091922 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.092047 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.092268 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.092382 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.092620 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.092737 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.092959 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.093070 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.093305 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.093417 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.093673 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.093779 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.094023 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.094135 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.094368 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.094479 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.094711 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.094816 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.095056 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.095167 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.095474 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.095582 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.095819 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.095925 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.096164 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.096274 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.096511 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.096623 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.096862 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.096973 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.097205 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.097315 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.097557 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.097661 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.097907 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.098012 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.098255 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.098360 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.098609 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.098725 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.098957 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.099061 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.099302 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.099488 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.099672 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.099785 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.100022 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.100125 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.100364 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.100475 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.100709 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.100828 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.101067 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.101171 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.101976 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.102257 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.102374 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.102500 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.102616 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.102817 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.102929 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.103177 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.103370 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.103562 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.103678 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.103923 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.104274 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.104384 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.104623 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.104729 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.104980 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.105128 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.105341 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.105445 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.105702 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.105808 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.106052 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.106163 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.106404 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.106516 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.106761 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.106868 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.107104 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.107208 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.107478 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.107586 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.107837 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.107949 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.108183 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.108287 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.108520 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.108631 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.108865 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.108968 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.109202 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.109306 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.109547 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.109659 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.109886 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.109991 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.110237 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.110341 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.110582 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.110720 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.110918 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.111032 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.111263 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.111425 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.111639 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.111759 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.111997 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.112107 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.112343 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.112480 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.112696 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.112825 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.113042 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.113154 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.113410 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.113514 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.113760 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.113870 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.114107 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.114216 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.114442 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.114547 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.114788 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.114892 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.115142 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.115247 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.115521 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.115637 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.115867 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.115972 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.116242 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.116353 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.116603 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.116713 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.116970 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.117584 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.117839 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.118153 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.118258 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.118530 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.118641 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.118875 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.118979 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.119225 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.119354 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.119598 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.119703 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.119943 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.120047 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.120295 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.120397 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.120649 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.120753 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.120993 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.121097 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.121338 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.121448 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.121686 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.121790 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.122030 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.122139 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.122383 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.122517 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.122721 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.122850 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.123063 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.123190 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.123441 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.123564 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.123787 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.123890 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.124135 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.124239 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.124472 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.124584 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.124840 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.124944 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.125187 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.125290 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.125523 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.125636 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.125872 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.125977 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.126215 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.126325 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.126560 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.126673 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.126909 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.127062 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.127280 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.127452 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.127665 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.127819 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.128012 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.128174 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.128364 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.128534 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.128710 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.128897 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.129026 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.129263 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.129366 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.129626 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.129738 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.129981 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.130092 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.130327 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.130473 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.130673 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.130833 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.131023 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.131193 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.131399 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.131583 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.131770 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.131938 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.132120 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.132291 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.132465 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.132692 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.132943 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.133068 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.133346 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.133459 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.133981 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.134093 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.134335 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.134440 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.134712 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.134843 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.135066 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.135178 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.135458 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.135577 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.135825 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.135935 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.136181 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.136265 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.136527 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.136612 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.136892 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.137070 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.137245 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.137435 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.137600 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.137796 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.137945 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.138177 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.138281 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.138558 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.138662 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.138938 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.139047 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.139284 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.139450 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.139670 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.139782 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.140029 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.140134 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.140395 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.140498 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.140740 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.140850 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.141095 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.141206 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.141446 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.141576 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.141791 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.141909 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.142136 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.142265 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.142487 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.142604 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.142839 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.142942 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.143194 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.143311 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.143569 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.143691 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.143922 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.144027 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.144280 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.144398 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.144625 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.144739 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.144976 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.145079 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.145325 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.145428 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.145748 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.145880 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.146024 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.146109 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.146376 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.146466 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.146720 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.146832 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.147063 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.147174 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.147431 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.147539 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.147783 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.147895 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.148128 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.148271 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.148521 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.148756 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.148932 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.149108 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.149219 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.149460 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.149569 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.149806 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.149918 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.150157 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.150261 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.150510 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.150616 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.150871 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.150986 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.151228 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.151355 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.151602 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.151767 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.151980 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.152086 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.152340 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.152450 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.152695 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.152810 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.153048 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.153155 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.153386 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.153499 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.153731 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.153846 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.154082 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.154193 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.154450 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.154554 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.154787 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.154898 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.155132 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.155243 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.155499 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.155604 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.155869 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.155988 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.156213 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.156387 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.156578 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.156683 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.156976 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.157094 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.157365 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.157476 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.157705 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.157815 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.158052 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.158165 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.158415 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.158519 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.158772 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.158882 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.159126 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.159239 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.159508 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.159614 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.159869 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.159983 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.160208 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.160313 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.160556 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.160667 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.160904 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.161007 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.161275 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.161387 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.161630 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.161740 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.161976 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.162087 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.162333 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.162474 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.162679 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.162783 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.163032 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.163179 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.163427 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.163560 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.163787 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.164502 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.164739 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.164850 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.165161 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.165273 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.165533 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.165637 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.165884 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.165995 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.166252 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.166356 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.166604 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.166714 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.166945 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.167061 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.167291 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.167427 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.167667 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.167771 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.168012 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.168123 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.168356 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.168467 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.168713 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.168880 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.169054 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.169166 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.169407 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.169539 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.169757 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.169908 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.170100 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.170211 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.170443 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.170554 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.170788 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.170894 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.171159 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.171443 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.171552 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.171825 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.171987 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.172200 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.172315 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.driver = filter_scheduler {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.172556 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.172667 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.172917 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.173035 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.173258 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.173371 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.173617 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.173713 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.173959 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.174053 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.174304 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.174408 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.periodic_task_interval = 60 {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.174646 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.174817 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.174992 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.175097 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = False {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.175381 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.175501 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.175746 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.175856 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.176100 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.176212 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.176478 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.176582 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.176853 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.176957 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.177205 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.177296 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.177561 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.178100 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.178190 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.178266 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.178266 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.178403 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.178597 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.178689 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.178968 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.179063 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.179314 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.179421 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.180226 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.180336 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.180579 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.180672 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.180935 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.181088 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.181263 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.181339 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.181605 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.181698 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.181958 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.182110 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.182364 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.182438 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.182628 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.182720 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.182974 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.183065 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.183348 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.183436 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.183692 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.183793 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.184063 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.184206 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.184414 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.184545 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.184762 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.184879 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.185105 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.185217 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.185452 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.185556 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.185821 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.185934 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.186161 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.186436 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.186542 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.186799 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.186903 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.187190 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.187301 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.187586 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.187691 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.187938 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.188053 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.188298 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.188412 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.188647 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.188752 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.189001 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = None {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.189118 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.189350 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.189454 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.189694 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.189798 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.190042 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.190158 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.190394 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.190526 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.190741 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.190889 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.191090 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = False {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.191207 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.191463 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.191573 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.191814 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.191921 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.192162 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.192267 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.192511 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.192787 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.193136 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.193247 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.193512 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.driver = filter_scheduler {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.193624 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.193867 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.193971 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.194219 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.194347 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.194570 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.194727 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.194927 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.195039 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.195302 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.195429 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.195731 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.195846 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.periodic_task_interval = 60 {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.196092 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.196202 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.196445 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = False {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.196561 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.196795 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.196900 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.197156 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.197267 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.197511 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.197624 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.197865 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.197970 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.198226 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.198330 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.198574 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.198690 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.198919 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.199025 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.199267 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.199386 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.199647 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.199753 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.200028 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.200137 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.200381 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.200492 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.200723 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.200834 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.201069 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.201174 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.201429 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.201541 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.201777 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.201888 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.202126 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.202265 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.202470 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.202573 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.202816 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.202928 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.203169 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.203311 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.203563 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.203680 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.203913 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.204025 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.204259 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.204370 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.204610 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.204754 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.204971 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.205113 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.205318 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.205430 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.205668 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.205781 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.206017 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.206140 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.206371 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.206490 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.206718 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.206817 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.207085 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.207307 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.207459 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.207686 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.207843 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.208064 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.208176 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.208432 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.208539 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.208804 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.209161 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.209296 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.209520 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.209628 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.209872 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = None {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.210126 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.210243 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.210518 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.210638 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.210955 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.211069 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.211408 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.211578 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.211751 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.211856 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.212106 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = False {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.212218 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.212459 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.212567 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.212805 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.212911 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.213167 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.213272 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.213521 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.213627 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.213882 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.214131 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.214243 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.214534 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.214651 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.214892 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.215009 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.215243 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.215357 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.215629 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.215807 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.215981 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.216086 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.216329 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.216457 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.216678 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.216784 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.217021 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.217126 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.217367 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.217478 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.217721 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.217826 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.218071 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.218183 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.218415 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.218520 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.218759 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.218870 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.219111 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.219222 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.219475 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.219598 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.219819 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.219931 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.220168 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.220284 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.220512 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.220624 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.220881 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.220991 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.221219 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.221324 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.221566 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.221683 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.221909 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.222043 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.222261 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.222367 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.222609 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.222725 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.222952 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.223057 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.223296 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.223504 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.223662 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.223815 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.224013 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.224218 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.224330 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.224602 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.224766 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.224958 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.225089 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.225313 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.225463 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.225652 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.225769 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.226001 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.226110 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.226861 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.226977 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.227244 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.227383 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.227709 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.227815 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.228059 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.228163 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.228419 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.228524 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.228772 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.228889 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.229126 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.229258 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.229474 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.229585 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.229827 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.229938 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.230190 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.230489 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.230600 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.230852 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.230956 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.231241 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.231490 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.231606 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.231878 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.231989 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.232243 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.232355 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.232635 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.232750 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.232980 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.233085 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.233343 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.233455 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.233684 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.233795 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] database.use_db_reconnect = False {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.234034 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.234144 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] database.use_tpool = False {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.234398 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.234511 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.234751 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.234836 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.235105 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.235242 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.235494 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.235593 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.235841 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.235947 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.236194 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.236312 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.236547 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.236660 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.236895 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.237000 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.237247 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.237358 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.237598 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.237715 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.237948 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.238060 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.238309 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.238414 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.238671 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.238784 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.239023 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.239129 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.239396 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.239504 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.239761 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.239869 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.240106 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.240219 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.240458 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.240564 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.240812 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.240924 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.241163 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.241288 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.241529 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.241659 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.241890 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.242037 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.242311 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.242421 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.242655 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.242771 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.243112 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.243222 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.243496 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.243597 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.243855 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.243968 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.244213 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.244326 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.244557 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.244656 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.244911 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.245044 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.245336 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.245467 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.245645 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.245745 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.246011 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.246130 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.246412 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.246542 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.246706 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.246814 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.247054 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.247161 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.247429 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.247541 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.247827 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.247941 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.248209 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.248324 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.248572 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.248680 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.248851 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=98153) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2591}} Feb 19 04:58:38.248972 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.249288 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.249646 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.249999 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.250354 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.250708 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.251059 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.251446 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.251811 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.252173 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.252524 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.252895 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.253247 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.253607 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.253954 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.254309 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.254658 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] database.use_db_reconnect = False {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.255015 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] database.use_tpool = False {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.255422 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.255778 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.256147 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.256497 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.256864 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.257216 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.258119 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.258491 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.259103 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.259469 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.259849 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.260202 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.260555 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.260910 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.261267 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.261622 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.261973 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.262350 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.262723 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.263069 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.263467 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.263830 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.264189 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.264545 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.264896 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.265271 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.265625 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.265980 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.266332 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.266683 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.267040 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.267443 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.267817 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.268188 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.268560 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.268936 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.269334 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.269685 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.270077 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.270455 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 04:58:38.270715 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=98154) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2591}} Feb 19 04:58:38.285809 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_db.sqlalchemy.engines [None req-4c56b6a3-490e-48f6-b2c7-0d7070445745 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=98153) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Feb 19 04:58:38.306440 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_db.sqlalchemy.engines [None req-223ff76d-9983-4835-aa86-52268dde6673 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=98154) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Feb 19 04:58:38.554983 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.context [None req-4c56b6a3-490e-48f6-b2c7-0d7070445745 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),8317eecd-4287-4458-b94f-e801df0b7699(cell1) {{(pid=98153) load_cells /opt/stack/nova/nova/context.py:466}} Feb 19 04:58:38.560650 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-4c56b6a3-490e-48f6-b2c7-0d7070445745 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 04:58:38.562512 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-4c56b6a3-490e-48f6-b2c7-0d7070445745 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 04:58:38.565788 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-4c56b6a3-490e-48f6-b2c7-0d7070445745 None None] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 04:58:38.565788 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-4c56b6a3-490e-48f6-b2c7-0d7070445745 None None] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 04:58:38.574752 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.context [None req-223ff76d-9983-4835-aa86-52268dde6673 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),8317eecd-4287-4458-b94f-e801df0b7699(cell1) {{(pid=98154) load_cells /opt/stack/nova/nova/context.py:466}} Feb 19 04:58:38.580636 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-223ff76d-9983-4835-aa86-52268dde6673 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 04:58:38.582530 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-223ff76d-9983-4835-aa86-52268dde6673 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 04:58:38.583455 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-223ff76d-9983-4835-aa86-52268dde6673 None None] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 04:58:38.585639 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-223ff76d-9983-4835-aa86-52268dde6673 None None] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 04:58:38.600250 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_db.sqlalchemy.engines [None req-4c56b6a3-490e-48f6-b2c7-0d7070445745 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=98153) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Feb 19 04:58:38.601192 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_db.sqlalchemy.engines [None req-4c56b6a3-490e-48f6-b2c7-0d7070445745 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=98153) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Feb 19 04:58:38.609718 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_db.sqlalchemy.engines [None req-223ff76d-9983-4835-aa86-52268dde6673 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=98154) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Feb 19 04:58:38.617974 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_db.sqlalchemy.engines [None req-223ff76d-9983-4835-aa86-52268dde6673 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=98154) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Feb 19 04:58:38.635488 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_db.sqlalchemy.engines [None req-4c56b6a3-490e-48f6-b2c7-0d7070445745 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=98153) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Feb 19 04:58:38.650296 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_db.sqlalchemy.engines [None req-223ff76d-9983-4835-aa86-52268dde6673 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=98154) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Feb 19 04:58:38.721805 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 19 04:58:38.721805 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: from cryptography.utils import int_from_bytes Feb 19 04:58:38.722358 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 19 04:58:38.722358 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: from cryptography.utils import int_from_bytes Feb 19 04:58:38.740711 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 19 04:58:38.740711 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: from cryptography.utils import int_from_bytes Feb 19 04:58:38.741144 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 19 04:58:38.741144 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: from cryptography.utils import int_from_bytes Feb 19 04:58:38.800137 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO keyring.backend [None req-4c56b6a3-490e-48f6-b2c7-0d7070445745 None None] Loading Gnome Feb 19 04:58:38.822228 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO keyring.backend [None req-4c56b6a3-490e-48f6-b2c7-0d7070445745 None None] Loading Google Feb 19 04:58:38.822777 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO keyring.backend [None req-223ff76d-9983-4835-aa86-52268dde6673 None None] Loading Gnome Feb 19 04:58:38.826192 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO keyring.backend [None req-4c56b6a3-490e-48f6-b2c7-0d7070445745 None None] Loading Windows (alt) Feb 19 04:58:38.830817 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO keyring.backend [None req-4c56b6a3-490e-48f6-b2c7-0d7070445745 None None] Loading file Feb 19 04:58:38.831956 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO keyring.backend [None req-4c56b6a3-490e-48f6-b2c7-0d7070445745 None None] Loading keyczar Feb 19 04:58:38.832420 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO keyring.backend [None req-4c56b6a3-490e-48f6-b2c7-0d7070445745 None None] Loading multi Feb 19 04:58:38.833437 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO keyring.backend [None req-4c56b6a3-490e-48f6-b2c7-0d7070445745 None None] Loading pyfs Feb 19 04:58:38.843421 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO keyring.backend [None req-223ff76d-9983-4835-aa86-52268dde6673 None None] Loading Google Feb 19 04:58:38.846888 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO keyring.backend [None req-223ff76d-9983-4835-aa86-52268dde6673 None None] Loading Windows (alt) Feb 19 04:58:38.852545 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO keyring.backend [None req-223ff76d-9983-4835-aa86-52268dde6673 None None] Loading file Feb 19 04:58:38.853460 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO keyring.backend [None req-223ff76d-9983-4835-aa86-52268dde6673 None None] Loading keyczar Feb 19 04:58:38.853918 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO keyring.backend [None req-223ff76d-9983-4835-aa86-52268dde6673 None None] Loading multi Feb 19 04:58:38.854931 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO keyring.backend [None req-223ff76d-9983-4835-aa86-52268dde6673 None None] Loading pyfs Feb 19 04:58:39.231061 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: WARNING keystonemiddleware.auth_token [None req-4c56b6a3-490e-48f6-b2c7-0d7070445745 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Feb 19 04:58:39.239010 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: WARNING keystonemiddleware.auth_token [None req-4c56b6a3-490e-48f6-b2c7-0d7070445745 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Feb 19 04:58:39.249962 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: WARNING keystonemiddleware.auth_token [None req-223ff76d-9983-4835-aa86-52268dde6673 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Feb 19 04:58:39.257399 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: WARNING keystonemiddleware.auth_token [None req-223ff76d-9983-4835-aa86-52268dde6673 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Feb 19 04:58:39.477758 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: WARNING keystonemiddleware.auth_token [None req-4c56b6a3-490e-48f6-b2c7-0d7070445745 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Feb 19 04:58:39.483633 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: WARNING keystonemiddleware.auth_token [None req-4c56b6a3-490e-48f6-b2c7-0d7070445745 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Feb 19 04:58:39.489243 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55a8e117e9c0 pid: 98153 (default app) Feb 19 04:58:39.491498 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: WARNING keystonemiddleware.auth_token [None req-223ff76d-9983-4835-aa86-52268dde6673 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Feb 19 04:58:39.497336 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: WARNING keystonemiddleware.auth_token [None req-223ff76d-9983-4835-aa86-52268dde6673 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Feb 19 04:58:39.502892 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55a8e117e9c0 pid: 98154 (default app) Feb 19 04:59:19.510689 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-e36ca00b-dd15-45c9-acd0-0737dcc75943 tempest-VolumesSnapshotsTestJSON-209386324 tempest-VolumesSnapshotsTestJSON-209386324-project] Action: 'create', calling method: .version_select at 0x7f27085c97b8>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1102612721"}} {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 04:59:21.132032 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-e36ca00b-dd15-45c9-acd0-0737dcc75943 tempest-VolumesSnapshotsTestJSON-209386324 tempest-VolumesSnapshotsTestJSON-209386324-project] 10.222.0.47 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 3.066793 Feb 19 04:59:21.133809 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 1/1] 10.222.0.47 () {60 vars in 1145 bytes} [Fri Feb 19 04:59:18 2021] POST /compute/v2.1/os-volumes => generated 345 bytes in 3070 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Feb 19 04:59:21.147836 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-5c182b4d-f6ac-424a-bba1-7f814b942121 tempest-VolumesSnapshotsTestJSON-209386324 tempest-VolumesSnapshotsTestJSON-209386324-project] Calling method '.version_select at 0x7f270848c048>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 04:59:21.198418 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-fd97dad8-dfbb-4b25-ac47-37d35b421574 tempest-VolumesNegativeTest-1491976600 tempest-VolumesNegativeTest-1491976600-project] Action: 'create', calling method: .version_select at 0x7f27085cb730>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-26706325", "metadata": {"Type": "work"}}} {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 04:59:21.201452 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-fd97dad8-dfbb-4b25-ac47-37d35b421574 tempest-VolumesNegativeTest-1491976600 tempest-VolumesNegativeTest-1491976600-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=98154) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 19 04:59:21.205733 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-fd97dad8-dfbb-4b25-ac47-37d35b421574 tempest-VolumesNegativeTest-1491976600 tempest-VolumesNegativeTest-1491976600-project] 10.222.0.47 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.504830 Feb 19 04:59:21.215991 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 1/2] 10.222.0.47 () {60 vars in 1146 bytes} [Fri Feb 19 04:59:19 2021] POST /compute/v2.1/os-volumes => generated 127 bytes in 1517 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Feb 19 04:59:21.225922 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-569f0321-4185-4962-b5d8-9a94262e7188 tempest-VolumesNegativeTest-1491976600 tempest-VolumesNegativeTest-1491976600-project] Action: 'create', calling method: .version_select at 0x7f270848a1e0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1654872736", "metadata": {"Type": "work"}}} {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 04:59:21.230741 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-569f0321-4185-4962-b5d8-9a94262e7188 tempest-VolumesNegativeTest-1491976600 tempest-VolumesNegativeTest-1491976600-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=98154) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 19 04:59:21.232135 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-569f0321-4185-4962-b5d8-9a94262e7188 tempest-VolumesNegativeTest-1491976600 tempest-VolumesNegativeTest-1491976600-project] 10.222.0.47 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.014686 Feb 19 04:59:21.232985 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 2/3] 10.222.0.47 () {60 vars in 1146 bytes} [Fri Feb 19 04:59:21 2021] POST /compute/v2.1/os-volumes => generated 125 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Feb 19 04:59:21.251011 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-2e0910ce-120d-4e7e-8640-134500fb598b tempest-VolumesNegativeTest-1491976600 tempest-VolumesNegativeTest-1491976600-project] Action: 'create', calling method: .version_select at 0x7f270baf89d8>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-2105939285", "metadata": {"Type": "work"}}} {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 04:59:21.255465 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-2e0910ce-120d-4e7e-8640-134500fb598b tempest-VolumesNegativeTest-1491976600 tempest-VolumesNegativeTest-1491976600-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=98154) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 19 04:59:21.258263 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-2e0910ce-120d-4e7e-8640-134500fb598b tempest-VolumesNegativeTest-1491976600 tempest-VolumesNegativeTest-1491976600-project] 10.222.0.47 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.009440 Feb 19 04:59:21.259387 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 3/4] 10.222.0.47 () {60 vars in 1146 bytes} [Fri Feb 19 04:59:21 2021] POST /compute/v2.1/os-volumes => generated 121 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Feb 19 04:59:21.276677 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-868a6722-9619-4328-9859-00768174bb90 tempest-VolumesNegativeTest-1491976600 tempest-VolumesNegativeTest-1491976600-project] Calling method '.version_select at 0x7f270848a268>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 04:59:21.311938 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-5c182b4d-f6ac-424a-bba1-7f814b942121 tempest-VolumesSnapshotsTestJSON-209386324 tempest-VolumesSnapshotsTestJSON-209386324-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/b9336885-a4fa-482b-86c5-400ce943357d" status: 200 len: 345 microversion: 2.1 time: 0.168393 Feb 19 04:59:21.312542 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 2/5] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Feb 19 04:59:21 2021] GET /compute/v2.1/os-volumes/b9336885-a4fa-482b-86c5-400ce943357d => generated 345 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 19 04:59:21.664153 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.wsgi [None req-868a6722-9619-4328-9859-00768174bb90 tempest-VolumesNegativeTest-1491976600 tempest-VolumesNegativeTest-1491976600-project] HTTP exception thrown: Volume tempest-invalid-1766956155 could not be found. Feb 19 04:59:21.665066 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-868a6722-9619-4328-9859-00768174bb90 tempest-VolumesNegativeTest-1491976600 tempest-VolumesNegativeTest-1491976600-project] Returning 404 to user: Volume tempest-invalid-1766956155 could not be found. {{(pid=98154) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 19 04:59:21.666189 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-868a6722-9619-4328-9859-00768174bb90 tempest-VolumesNegativeTest-1491976600 tempest-VolumesNegativeTest-1491976600-project] 10.222.0.47 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1766956155" status: 404 len: 99 microversion: 2.1 time: 0.398793 Feb 19 04:59:21.667021 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 4/6] 10.222.0.47 () {58 vars in 1208 bytes} [Fri Feb 19 04:59:21 2021] DELETE /compute/v2.1/os-volumes/tempest-invalid-1766956155 => generated 99 bytes in 400 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Feb 19 04:59:21.676861 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-2ec02a13-641d-463b-84f9-0c70c63a616f tempest-VolumesNegativeTest-1491976600 tempest-VolumesNegativeTest-1491976600-project] 10.222.0.47 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004003 Feb 19 04:59:21.682575 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 3/7] 10.222.0.47 () {58 vars in 1130 bytes} [Fri Feb 19 04:59:21 2021] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 10 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Feb 19 04:59:21.688219 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-614e0b8b-adfc-4ca1-8013-cb34c127e902 tempest-VolumesNegativeTest-1491976600 tempest-VolumesNegativeTest-1491976600-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004048 Feb 19 04:59:21.689065 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 5/8] 10.222.0.47 () {58 vars in 1127 bytes} [Fri Feb 19 04:59:21 2021] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Feb 19 04:59:21.698882 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-02fa6c4e-7bc1-429f-bd6f-b012ffb0e3f3 tempest-VolumesNegativeTest-1491976600 tempest-VolumesNegativeTest-1491976600-project] Calling method '.version_select at 0x7f270856c048>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 04:59:21.828305 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.wsgi [None req-02fa6c4e-7bc1-429f-bd6f-b012ffb0e3f3 tempest-VolumesNegativeTest-1491976600 tempest-VolumesNegativeTest-1491976600-project] HTTP exception thrown: Volume d64050ec-8daf-43ed-942b-f284d496a2e7 could not be found. Feb 19 04:59:21.828985 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-02fa6c4e-7bc1-429f-bd6f-b012ffb0e3f3 tempest-VolumesNegativeTest-1491976600 tempest-VolumesNegativeTest-1491976600-project] Returning 404 to user: Volume d64050ec-8daf-43ed-942b-f284d496a2e7 could not be found. {{(pid=98153) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 19 04:59:21.831217 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-02fa6c4e-7bc1-429f-bd6f-b012ffb0e3f3 tempest-VolumesNegativeTest-1491976600 tempest-VolumesNegativeTest-1491976600-project] 10.222.0.47 "DELETE /compute/v2.1/os-volumes/d64050ec-8daf-43ed-942b-f284d496a2e7" status: 404 len: 109 microversion: 2.1 time: 0.136392 Feb 19 04:59:21.832227 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 4/9] 10.222.0.47 () {58 vars in 1238 bytes} [Fri Feb 19 04:59:21 2021] DELETE /compute/v2.1/os-volumes/d64050ec-8daf-43ed-942b-f284d496a2e7 => generated 109 bytes in 138 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 04:59:21.843316 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-0f4f4825-2b79-473f-bff0-db8aa2e70ab7 tempest-VolumesNegativeTest-1491976600 tempest-VolumesNegativeTest-1491976600-project] Calling method '.version_select at 0x7f27085a5378>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 04:59:21.995074 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.wsgi [None req-0f4f4825-2b79-473f-bff0-db8aa2e70ab7 tempest-VolumesNegativeTest-1491976600 tempest-VolumesNegativeTest-1491976600-project] HTTP exception thrown: Volume c66eef8c-ad7a-4b4e-96c2-d0e6d3877af1 could not be found. Feb 19 04:59:21.996466 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-0f4f4825-2b79-473f-bff0-db8aa2e70ab7 tempest-VolumesNegativeTest-1491976600 tempest-VolumesNegativeTest-1491976600-project] Returning 404 to user: Volume c66eef8c-ad7a-4b4e-96c2-d0e6d3877af1 could not be found. {{(pid=98154) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 19 04:59:21.997377 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-0f4f4825-2b79-473f-bff0-db8aa2e70ab7 tempest-VolumesNegativeTest-1491976600 tempest-VolumesNegativeTest-1491976600-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/c66eef8c-ad7a-4b4e-96c2-d0e6d3877af1" status: 404 len: 109 microversion: 2.1 time: 0.159064 Feb 19 04:59:21.997977 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 6/10] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Feb 19 04:59:21 2021] GET /compute/v2.1/os-volumes/c66eef8c-ad7a-4b4e-96c2-d0e6d3877af1 => generated 109 bytes in 160 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 04:59:22.325987 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-f09b1678-ee19-498d-a85a-d213f98dc51b tempest-VolumesSnapshotsTestJSON-209386324 tempest-VolumesSnapshotsTestJSON-209386324-project] Calling method '.version_select at 0x7f2708554ea0>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 04:59:22.535103 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-f09b1678-ee19-498d-a85a-d213f98dc51b tempest-VolumesSnapshotsTestJSON-209386324 tempest-VolumesSnapshotsTestJSON-209386324-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/b9336885-a4fa-482b-86c5-400ce943357d" status: 200 len: 346 microversion: 2.1 time: 0.212950 Feb 19 04:59:22.535785 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 5/11] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Feb 19 04:59:22 2021] GET /compute/v2.1/os-volumes/b9336885-a4fa-482b-86c5-400ce943357d => generated 346 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 04:59:22.548319 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-399c6f00-6b74-40a5-9553-f0ac0902bfff tempest-VolumesSnapshotsTestJSON-209386324 tempest-VolumesSnapshotsTestJSON-209386324-project] Action: 'create', calling method: .version_select at 0x7f27085a59d8>, body: {"snapshot": {"volume_id": "b9336885-a4fa-482b-86c5-400ce943357d", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-695889016"}} {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 04:59:22.964486 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-399c6f00-6b74-40a5-9553-f0ac0902bfff tempest-VolumesSnapshotsTestJSON-209386324 tempest-VolumesSnapshotsTestJSON-209386324-project] 10.222.0.47 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.420188 Feb 19 04:59:22.970118 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 7/12] 10.222.0.47 () {60 vars in 1152 bytes} [Fri Feb 19 04:59:22 2021] POST /compute/v2.1/os-snapshots => generated 286 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 04:59:22.981087 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-5e327d97-6aef-48a8-a65e-1ce744630450 tempest-VolumesSnapshotsTestJSON-209386324 tempest-VolumesSnapshotsTestJSON-209386324-project] Calling method '.version_select at 0x7f2708560048>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 04:59:23.088299 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-5e327d97-6aef-48a8-a65e-1ce744630450 tempest-VolumesSnapshotsTestJSON-209386324 tempest-VolumesSnapshotsTestJSON-209386324-project] 10.222.0.47 "GET /compute/v2.1/os-snapshots/8c2e57d2-1669-41c2-a7fd-db43f4223f43" status: 200 len: 286 microversion: 2.1 time: 0.110721 Feb 19 04:59:23.089435 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 6/13] 10.222.0.47 () {58 vars in 1241 bytes} [Fri Feb 19 04:59:22 2021] GET /compute/v2.1/os-snapshots/8c2e57d2-1669-41c2-a7fd-db43f4223f43 => generated 286 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 04:59:23.104695 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-de574ee8-1b21-4686-9889-fe750a842eca tempest-VolumesSnapshotsTestJSON-209386324 tempest-VolumesSnapshotsTestJSON-209386324-project] Calling method '.version_select at 0x7f27085520d0>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 04:59:23.167157 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-de574ee8-1b21-4686-9889-fe750a842eca tempest-VolumesSnapshotsTestJSON-209386324 tempest-VolumesSnapshotsTestJSON-209386324-project] 10.222.0.47 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.071060 Feb 19 04:59:23.168130 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 8/14] 10.222.0.47 () {58 vars in 1130 bytes} [Fri Feb 19 04:59:23 2021] GET /compute/v2.1/os-snapshots => generated 289 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 04:59:23.179279 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-56c30399-8efd-47af-a3bd-5eb095f54e75 tempest-VolumesSnapshotsTestJSON-209386324 tempest-VolumesSnapshotsTestJSON-209386324-project] Calling method '.version_select at 0x7f2708560510>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 04:59:23.247963 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-56c30399-8efd-47af-a3bd-5eb095f54e75 tempest-VolumesSnapshotsTestJSON-209386324 tempest-VolumesSnapshotsTestJSON-209386324-project] 10.222.0.47 "GET /compute/v2.1/os-snapshots/8c2e57d2-1669-41c2-a7fd-db43f4223f43" status: 200 len: 286 microversion: 2.1 time: 0.073299 Feb 19 04:59:23.249558 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 7/15] 10.222.0.47 () {58 vars in 1241 bytes} [Fri Feb 19 04:59:23 2021] GET /compute/v2.1/os-snapshots/8c2e57d2-1669-41c2-a7fd-db43f4223f43 => generated 286 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 04:59:24.262088 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-8793a5f7-b94a-42ec-b9a7-18129b617cd6 tempest-VolumesSnapshotsTestJSON-209386324 tempest-VolumesSnapshotsTestJSON-209386324-project] Calling method '.version_select at 0x7f27085a5bf8>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 04:59:24.344966 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-8793a5f7-b94a-42ec-b9a7-18129b617cd6 tempest-VolumesSnapshotsTestJSON-209386324 tempest-VolumesSnapshotsTestJSON-209386324-project] 10.222.0.47 "GET /compute/v2.1/os-snapshots/8c2e57d2-1669-41c2-a7fd-db43f4223f43" status: 200 len: 286 microversion: 2.1 time: 0.087809 Feb 19 04:59:24.351233 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 9/16] 10.222.0.47 () {58 vars in 1241 bytes} [Fri Feb 19 04:59:24 2021] GET /compute/v2.1/os-snapshots/8c2e57d2-1669-41c2-a7fd-db43f4223f43 => generated 286 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 04:59:25.357635 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-010afd15-79e2-4094-a399-3bd33edcf590 tempest-VolumesSnapshotsTestJSON-209386324 tempest-VolumesSnapshotsTestJSON-209386324-project] Calling method '.version_select at 0x7f2708560840>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 04:59:25.467486 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-010afd15-79e2-4094-a399-3bd33edcf590 tempest-VolumesSnapshotsTestJSON-209386324 tempest-VolumesSnapshotsTestJSON-209386324-project] 10.222.0.47 "GET /compute/v2.1/os-snapshots/8c2e57d2-1669-41c2-a7fd-db43f4223f43" status: 200 len: 286 microversion: 2.1 time: 0.113610 Feb 19 04:59:25.468350 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 8/17] 10.222.0.47 () {58 vars in 1241 bytes} [Fri Feb 19 04:59:25 2021] GET /compute/v2.1/os-snapshots/8c2e57d2-1669-41c2-a7fd-db43f4223f43 => generated 286 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 04:59:26.480597 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-ebf4f901-e28b-4663-916c-2808a6c9eed7 tempest-VolumesSnapshotsTestJSON-209386324 tempest-VolumesSnapshotsTestJSON-209386324-project] Calling method '.version_select at 0x7f27085a59d8>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 04:59:26.547868 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-ebf4f901-e28b-4663-916c-2808a6c9eed7 tempest-VolumesSnapshotsTestJSON-209386324 tempest-VolumesSnapshotsTestJSON-209386324-project] 10.222.0.47 "GET /compute/v2.1/os-snapshots/8c2e57d2-1669-41c2-a7fd-db43f4223f43" status: 200 len: 286 microversion: 2.1 time: 0.072520 Feb 19 04:59:26.549503 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 10/18] 10.222.0.47 () {58 vars in 1241 bytes} [Fri Feb 19 04:59:26 2021] GET /compute/v2.1/os-snapshots/8c2e57d2-1669-41c2-a7fd-db43f4223f43 => generated 286 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 04:59:27.561353 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-992891c1-4a30-4680-97e7-7e5a6b51311e tempest-VolumesSnapshotsTestJSON-209386324 tempest-VolumesSnapshotsTestJSON-209386324-project] Calling method '.version_select at 0x7f270848c0d0>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 04:59:27.619860 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-992891c1-4a30-4680-97e7-7e5a6b51311e tempest-VolumesSnapshotsTestJSON-209386324 tempest-VolumesSnapshotsTestJSON-209386324-project] 10.222.0.47 "GET /compute/v2.1/os-snapshots/8c2e57d2-1669-41c2-a7fd-db43f4223f43" status: 200 len: 287 microversion: 2.1 time: 0.062757 Feb 19 04:59:27.621313 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 9/19] 10.222.0.47 () {58 vars in 1241 bytes} [Fri Feb 19 04:59:27 2021] GET /compute/v2.1/os-snapshots/8c2e57d2-1669-41c2-a7fd-db43f4223f43 => generated 287 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 04:59:27.633260 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-161f215c-3f2a-4aa2-acf1-7b1a350bd882 tempest-VolumesSnapshotsTestJSON-209386324 tempest-VolumesSnapshotsTestJSON-209386324-project] Calling method '.version_select at 0x7f27085522f0>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 04:59:27.779990 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-161f215c-3f2a-4aa2-acf1-7b1a350bd882 tempest-VolumesSnapshotsTestJSON-209386324 tempest-VolumesSnapshotsTestJSON-209386324-project] 10.222.0.47 "DELETE /compute/v2.1/os-snapshots/8c2e57d2-1669-41c2-a7fd-db43f4223f43" status: 202 len: 0 microversion: 2.1 time: 0.151514 Feb 19 04:59:27.780665 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 11/20] 10.222.0.47 () {58 vars in 1244 bytes} [Fri Feb 19 04:59:27 2021] DELETE /compute/v2.1/os-snapshots/8c2e57d2-1669-41c2-a7fd-db43f4223f43 => generated 0 bytes in 153 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 19 04:59:27.789508 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-7580fa44-a3f3-4806-991c-a009866847d2 tempest-VolumesSnapshotsTestJSON-209386324 tempest-VolumesSnapshotsTestJSON-209386324-project] Calling method '.version_select at 0x7f2708560730>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 04:59:27.876691 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-7580fa44-a3f3-4806-991c-a009866847d2 tempest-VolumesSnapshotsTestJSON-209386324 tempest-VolumesSnapshotsTestJSON-209386324-project] 10.222.0.47 "GET /compute/v2.1/os-snapshots/8c2e57d2-1669-41c2-a7fd-db43f4223f43" status: 200 len: 286 microversion: 2.1 time: 0.091293 Feb 19 04:59:27.877791 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 10/21] 10.222.0.47 () {58 vars in 1241 bytes} [Fri Feb 19 04:59:27 2021] GET /compute/v2.1/os-snapshots/8c2e57d2-1669-41c2-a7fd-db43f4223f43 => generated 286 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 04:59:28.890461 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-0a0f3b56-013c-4fa1-8f5c-bf1fb1dc7c4a tempest-VolumesSnapshotsTestJSON-209386324 tempest-VolumesSnapshotsTestJSON-209386324-project] Calling method '.version_select at 0x7f2708552730>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 04:59:29.013156 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.wsgi [None req-0a0f3b56-013c-4fa1-8f5c-bf1fb1dc7c4a tempest-VolumesSnapshotsTestJSON-209386324 tempest-VolumesSnapshotsTestJSON-209386324-project] HTTP exception thrown: Snapshot 8c2e57d2-1669-41c2-a7fd-db43f4223f43 could not be found. Feb 19 04:59:29.013917 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-0a0f3b56-013c-4fa1-8f5c-bf1fb1dc7c4a tempest-VolumesSnapshotsTestJSON-209386324 tempest-VolumesSnapshotsTestJSON-209386324-project] Returning 404 to user: Snapshot 8c2e57d2-1669-41c2-a7fd-db43f4223f43 could not be found. {{(pid=98154) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 19 04:59:29.014997 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-0a0f3b56-013c-4fa1-8f5c-bf1fb1dc7c4a tempest-VolumesSnapshotsTestJSON-209386324 tempest-VolumesSnapshotsTestJSON-209386324-project] 10.222.0.47 "GET /compute/v2.1/os-snapshots/8c2e57d2-1669-41c2-a7fd-db43f4223f43" status: 404 len: 111 microversion: 2.1 time: 0.129494 Feb 19 04:59:29.016700 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 12/22] 10.222.0.47 () {58 vars in 1241 bytes} [Fri Feb 19 04:59:28 2021] GET /compute/v2.1/os-snapshots/8c2e57d2-1669-41c2-a7fd-db43f4223f43 => generated 111 bytes in 132 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 04:59:29.027084 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-a75bf05c-6a06-42eb-a0c4-38b12816d1f3 tempest-VolumesSnapshotsTestJSON-209386324 tempest-VolumesSnapshotsTestJSON-209386324-project] Calling method '.version_select at 0x7f2708560598>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 04:59:29.238470 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-a75bf05c-6a06-42eb-a0c4-38b12816d1f3 tempest-VolumesSnapshotsTestJSON-209386324 tempest-VolumesSnapshotsTestJSON-209386324-project] 10.222.0.47 "DELETE /compute/v2.1/os-volumes/b9336885-a4fa-482b-86c5-400ce943357d" status: 202 len: 0 microversion: 2.1 time: 0.215884 Feb 19 04:59:29.239148 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 11/23] 10.222.0.47 () {58 vars in 1238 bytes} [Fri Feb 19 04:59:29 2021] DELETE /compute/v2.1/os-volumes/b9336885-a4fa-482b-86c5-400ce943357d => generated 0 bytes in 218 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 19 04:59:29.252511 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-9a859c35-603e-4ab0-8017-43a7736db4a2 tempest-VolumesSnapshotsTestJSON-209386324 tempest-VolumesSnapshotsTestJSON-209386324-project] Calling method '.version_select at 0x7f2708552048>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 04:59:29.488360 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-9a859c35-603e-4ab0-8017-43a7736db4a2 tempest-VolumesSnapshotsTestJSON-209386324 tempest-VolumesSnapshotsTestJSON-209386324-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/b9336885-a4fa-482b-86c5-400ce943357d" status: 200 len: 345 microversion: 2.1 time: 0.243534 Feb 19 04:59:29.494886 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 13/24] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Feb 19 04:59:29 2021] GET /compute/v2.1/os-volumes/b9336885-a4fa-482b-86c5-400ce943357d => generated 345 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 04:59:30.227033 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-2d0c66b8-51a6-42ad-90ae-47fa7af14b9b tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-400752846", "imageRef": "53cdf9de-e495-4ca8-845f-6be2bf32cecb", "flavorRef": "452", "networks": [{"uuid": "f995194d-dcd5-48ad-baed-944751a68000"}]}} {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 04:59:30.433612 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.network.neutron [None req-2d0c66b8-51a6-42ad-90ae-47fa7af14b9b tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] validate_networks() for [('f995194d-dcd5-48ad-baed-944751a68000', None, None, None)] {{(pid=98153) validate_networks /opt/stack/nova/nova/network/neutron.py:2345}} Feb 19 04:59:30.502164 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-460fefb0-453a-4223-ba6c-d797fd7d4b82 tempest-VolumesSnapshotsTestJSON-209386324 tempest-VolumesSnapshotsTestJSON-209386324-project] Calling method '.version_select at 0x7f2708552400>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 04:59:30.652085 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.wsgi [None req-460fefb0-453a-4223-ba6c-d797fd7d4b82 tempest-VolumesSnapshotsTestJSON-209386324 tempest-VolumesSnapshotsTestJSON-209386324-project] HTTP exception thrown: Volume b9336885-a4fa-482b-86c5-400ce943357d could not be found. Feb 19 04:59:30.652815 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-460fefb0-453a-4223-ba6c-d797fd7d4b82 tempest-VolumesSnapshotsTestJSON-209386324 tempest-VolumesSnapshotsTestJSON-209386324-project] Returning 404 to user: Volume b9336885-a4fa-482b-86c5-400ce943357d could not be found. {{(pid=98154) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 19 04:59:30.654278 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-460fefb0-453a-4223-ba6c-d797fd7d4b82 tempest-VolumesSnapshotsTestJSON-209386324 tempest-VolumesSnapshotsTestJSON-209386324-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/b9336885-a4fa-482b-86c5-400ce943357d" status: 404 len: 109 microversion: 2.1 time: 0.155637 Feb 19 04:59:30.655200 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 14/25] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Feb 19 04:59:30 2021] GET /compute/v2.1/os-volumes/b9336885-a4fa-482b-86c5-400ce943357d => generated 109 bytes in 158 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 04:59:30.673563 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-936e1e3a-8495-4442-ba15-60377ba96c38 tempest-VolumesSnapshotsTestJSON-209386324 tempest-VolumesSnapshotsTestJSON-209386324-project] Calling method '.version_select at 0x7f2708552048>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 04:59:30.892969 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.wsgi [None req-936e1e3a-8495-4442-ba15-60377ba96c38 tempest-VolumesSnapshotsTestJSON-209386324 tempest-VolumesSnapshotsTestJSON-209386324-project] HTTP exception thrown: Volume b9336885-a4fa-482b-86c5-400ce943357d could not be found. Feb 19 04:59:30.895207 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-936e1e3a-8495-4442-ba15-60377ba96c38 tempest-VolumesSnapshotsTestJSON-209386324 tempest-VolumesSnapshotsTestJSON-209386324-project] Returning 404 to user: Volume b9336885-a4fa-482b-86c5-400ce943357d could not be found. {{(pid=98154) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 19 04:59:30.896432 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-936e1e3a-8495-4442-ba15-60377ba96c38 tempest-VolumesSnapshotsTestJSON-209386324 tempest-VolumesSnapshotsTestJSON-209386324-project] 10.222.0.47 "DELETE /compute/v2.1/os-volumes/b9336885-a4fa-482b-86c5-400ce943357d" status: 404 len: 109 microversion: 2.1 time: 0.227458 Feb 19 04:59:30.898067 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 15/26] 10.222.0.47 () {58 vars in 1238 bytes} [Fri Feb 19 04:59:30 2021] DELETE /compute/v2.1/os-volumes/b9336885-a4fa-482b-86c5-400ce943357d => generated 109 bytes in 230 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 04:59:30.910573 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-7d246302-8478-463b-8967-c71b50717848 tempest-VolumesSnapshotsTestJSON-209386324 tempest-VolumesSnapshotsTestJSON-209386324-project] Calling method '.version_select at 0x7f2708552bf8>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 04:59:31.104790 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.wsgi [None req-7d246302-8478-463b-8967-c71b50717848 tempest-VolumesSnapshotsTestJSON-209386324 tempest-VolumesSnapshotsTestJSON-209386324-project] HTTP exception thrown: Volume b9336885-a4fa-482b-86c5-400ce943357d could not be found. Feb 19 04:59:31.105547 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-7d246302-8478-463b-8967-c71b50717848 tempest-VolumesSnapshotsTestJSON-209386324 tempest-VolumesSnapshotsTestJSON-209386324-project] Returning 404 to user: Volume b9336885-a4fa-482b-86c5-400ce943357d could not be found. {{(pid=98154) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 19 04:59:31.106530 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-7d246302-8478-463b-8967-c71b50717848 tempest-VolumesSnapshotsTestJSON-209386324 tempest-VolumesSnapshotsTestJSON-209386324-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/b9336885-a4fa-482b-86c5-400ce943357d" status: 404 len: 109 microversion: 2.1 time: 0.203355 Feb 19 04:59:31.107282 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 16/27] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Feb 19 04:59:30 2021] GET /compute/v2.1/os-volumes/b9336885-a4fa-482b-86c5-400ce943357d => generated 109 bytes in 205 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 04:59:31.549881 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-6db6ed20-6581-4664-bbb4-b01af228c8e3 tempest-DeleteServersTestJSON-1855409151 tempest-DeleteServersTestJSON-1855409151-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1640213667", "imageRef": "53cdf9de-e495-4ca8-845f-6be2bf32cecb", "flavorRef": "452", "networks": [{"uuid": "5c3abb99-b290-44d2-a72a-214834634a57"}]}} {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 04:59:31.826542 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.network.neutron [None req-6db6ed20-6581-4664-bbb4-b01af228c8e3 tempest-DeleteServersTestJSON-1855409151 tempest-DeleteServersTestJSON-1855409151-project] validate_networks() for [('5c3abb99-b290-44d2-a72a-214834634a57', None, None, None)] {{(pid=98154) validate_networks /opt/stack/nova/nova/network/neutron.py:2345}} Feb 19 04:59:34.828199 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.virt.hardware [None req-2d0c66b8-51a6-42ad-90ae-47fa7af14b9b tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Flavor limits 0:0:0 {{(pid=98153) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 19 04:59:34.829467 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.virt.hardware [None req-2d0c66b8-51a6-42ad-90ae-47fa7af14b9b tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Image limits 0:0:0 {{(pid=98153) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Feb 19 04:59:34.830190 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.virt.hardware [None req-2d0c66b8-51a6-42ad-90ae-47fa7af14b9b tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Flavor pref 0:0:0 {{(pid=98153) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 19 04:59:34.830914 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.virt.hardware [None req-2d0c66b8-51a6-42ad-90ae-47fa7af14b9b tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Image pref 0:0:0 {{(pid=98153) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Feb 19 04:59:34.831951 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.virt.hardware [None req-2d0c66b8-51a6-42ad-90ae-47fa7af14b9b tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98153) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Feb 19 04:59:34.846350 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-2d0c66b8-51a6-42ad-90ae-47fa7af14b9b tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 04:59:34.847891 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-2d0c66b8-51a6-42ad-90ae-47fa7af14b9b tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 04:59:34.848999 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-2d0c66b8-51a6-42ad-90ae-47fa7af14b9b tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 04:59:34.849769 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-2d0c66b8-51a6-42ad-90ae-47fa7af14b9b tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 04:59:34.906551 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.virt.hardware [None req-6db6ed20-6581-4664-bbb4-b01af228c8e3 tempest-DeleteServersTestJSON-1855409151 tempest-DeleteServersTestJSON-1855409151-project] Flavor limits 0:0:0 {{(pid=98154) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 19 04:59:34.916243 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.virt.hardware [None req-6db6ed20-6581-4664-bbb4-b01af228c8e3 tempest-DeleteServersTestJSON-1855409151 tempest-DeleteServersTestJSON-1855409151-project] Image limits 0:0:0 {{(pid=98154) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Feb 19 04:59:34.918574 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.virt.hardware [None req-6db6ed20-6581-4664-bbb4-b01af228c8e3 tempest-DeleteServersTestJSON-1855409151 tempest-DeleteServersTestJSON-1855409151-project] Flavor pref 0:0:0 {{(pid=98154) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 19 04:59:34.920690 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.virt.hardware [None req-6db6ed20-6581-4664-bbb4-b01af228c8e3 tempest-DeleteServersTestJSON-1855409151 tempest-DeleteServersTestJSON-1855409151-project] Image pref 0:0:0 {{(pid=98154) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Feb 19 04:59:34.923092 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.virt.hardware [None req-6db6ed20-6581-4664-bbb4-b01af228c8e3 tempest-DeleteServersTestJSON-1855409151 tempest-DeleteServersTestJSON-1855409151-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98154) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Feb 19 04:59:34.925479 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.quota [None req-2d0c66b8-51a6-42ad-90ae-47fa7af14b9b tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Getting quotas for project aa473e12960449bbb0713a709e0abe4e. Resources: {'instances', 'ram', 'cores'} {{(pid=98153) _get_quotas /opt/stack/nova/nova/quota.py:388}} Feb 19 04:59:34.948740 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.quota [None req-2d0c66b8-51a6-42ad-90ae-47fa7af14b9b tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Getting quotas for user 628d846121a14be78329ccc727c8869d and project aa473e12960449bbb0713a709e0abe4e. Resources: {'instances', 'ram', 'cores'} {{(pid=98153) _get_quotas /opt/stack/nova/nova/quota.py:380}} Feb 19 04:59:34.956082 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-6db6ed20-6581-4664-bbb4-b01af228c8e3 tempest-DeleteServersTestJSON-1855409151 tempest-DeleteServersTestJSON-1855409151-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 04:59:34.962469 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-6db6ed20-6581-4664-bbb4-b01af228c8e3 tempest-DeleteServersTestJSON-1855409151 tempest-DeleteServersTestJSON-1855409151-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 04:59:34.963659 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-6db6ed20-6581-4664-bbb4-b01af228c8e3 tempest-DeleteServersTestJSON-1855409151 tempest-DeleteServersTestJSON-1855409151-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 04:59:34.964255 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-6db6ed20-6581-4664-bbb4-b01af228c8e3 tempest-DeleteServersTestJSON-1855409151 tempest-DeleteServersTestJSON-1855409151-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 04:59:34.967915 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-2d0c66b8-51a6-42ad-90ae-47fa7af14b9b tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Going to run 1 instances... {{(pid=98153) _provision_instances /opt/stack/nova/nova/compute/api.py:1264}} Feb 19 04:59:34.972366 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-2d0c66b8-51a6-42ad-90ae-47fa7af14b9b tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] [instance: 9b43c13a-0c7e-45d7-96b0-83fe593a8b08] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='53cdf9de-e495-4ca8-845f-6be2bf32cecb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98153) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1666}} Feb 19 04:59:35.013301 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.quota [None req-6db6ed20-6581-4664-bbb4-b01af228c8e3 tempest-DeleteServersTestJSON-1855409151 tempest-DeleteServersTestJSON-1855409151-project] Getting quotas for project 0703bf302bd646109e79f0f89f8938cf. Resources: {'instances', 'ram', 'cores'} {{(pid=98154) _get_quotas /opt/stack/nova/nova/quota.py:388}} Feb 19 04:59:35.029934 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.quota [None req-6db6ed20-6581-4664-bbb4-b01af228c8e3 tempest-DeleteServersTestJSON-1855409151 tempest-DeleteServersTestJSON-1855409151-project] Getting quotas for user 2fbe79c8c7e046b28563ce75526c5554 and project 0703bf302bd646109e79f0f89f8938cf. Resources: {'instances', 'ram', 'cores'} {{(pid=98154) _get_quotas /opt/stack/nova/nova/quota.py:380}} Feb 19 04:59:35.063194 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-6db6ed20-6581-4664-bbb4-b01af228c8e3 tempest-DeleteServersTestJSON-1855409151 tempest-DeleteServersTestJSON-1855409151-project] Going to run 1 instances... {{(pid=98154) _provision_instances /opt/stack/nova/nova/compute/api.py:1264}} Feb 19 04:59:35.074376 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-6db6ed20-6581-4664-bbb4-b01af228c8e3 tempest-DeleteServersTestJSON-1855409151 tempest-DeleteServersTestJSON-1855409151-project] [instance: cb93b585-b24f-444e-851a-98f0f13de9b2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='53cdf9de-e495-4ca8-845f-6be2bf32cecb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98154) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1666}} Feb 19 04:59:35.110385 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-2d0c66b8-51a6-42ad-90ae-47fa7af14b9b tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.721417 Feb 19 04:59:35.112109 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 12/28] 10.222.0.47 () {60 vars in 1137 bytes} [Fri Feb 19 04:59:29 2021] POST /compute/v2.1/servers => generated 380 bytes in 5725 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 19 04:59:35.130033 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-d09fa1b5-e68d-4d72-b993-668963e391cc tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 04:59:35.131315 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-d09fa1b5-e68d-4d72-b993-668963e391cc tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] [instance: 9b43c13a-0c7e-45d7-96b0-83fe593a8b08] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 04:59:35.424557 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-6db6ed20-6581-4664-bbb4-b01af228c8e3 tempest-DeleteServersTestJSON-1855409151 tempest-DeleteServersTestJSON-1855409151-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.310449 Feb 19 04:59:35.425743 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 17/29] 10.222.0.47 () {60 vars in 1137 bytes} [Fri Feb 19 04:59:31 2021] POST /compute/v2.1/servers => generated 380 bytes in 4313 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 19 04:59:35.462594 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-d09fa1b5-e68d-4d72-b993-668963e391cc tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628d846121a14be78329ccc727c8869d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa473e12960449bbb0713a709e0abe4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 04:59:35.471832 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-2e3264eb-eed4-4c12-8055-ceee14a5b6bf tempest-DeleteServersTestJSON-1855409151 tempest-DeleteServersTestJSON-1855409151-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 04:59:35.473157 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-2e3264eb-eed4-4c12-8055-ceee14a5b6bf tempest-DeleteServersTestJSON-1855409151 tempest-DeleteServersTestJSON-1855409151-project] [instance: cb93b585-b24f-444e-851a-98f0f13de9b2] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 04:59:35.555866 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-d09fa1b5-e68d-4d72-b993-668963e391cc tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] 10.222.0.47 "GET /compute/v2.1/servers/9b43c13a-0c7e-45d7-96b0-83fe593a8b08" status: 200 len: 1217 microversion: 2.1 time: 0.434206 Feb 19 04:59:35.561565 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 13/30] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 04:59:35 2021] GET /compute/v2.1/servers/9b43c13a-0c7e-45d7-96b0-83fe593a8b08 => generated 1217 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 04:59:36.581006 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-f45d4a28-cef0-499f-8912-07f491429913 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 04:59:36.582013 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-f45d4a28-cef0-499f-8912-07f491429913 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] [instance: 9b43c13a-0c7e-45d7-96b0-83fe593a8b08] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 04:59:36.675118 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-2e3264eb-eed4-4c12-8055-ceee14a5b6bf tempest-DeleteServersTestJSON-1855409151 tempest-DeleteServersTestJSON-1855409151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbe79c8c7e046b28563ce75526c5554', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0703bf302bd646109e79f0f89f8938cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 04:59:36.693371 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-2e3264eb-eed4-4c12-8055-ceee14a5b6bf tempest-DeleteServersTestJSON-1855409151 tempest-DeleteServersTestJSON-1855409151-project] 10.222.0.47 "GET /compute/v2.1/servers/cb93b585-b24f-444e-851a-98f0f13de9b2" status: 200 len: 1215 microversion: 2.1 time: 1.257223 Feb 19 04:59:36.694041 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 18/31] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 04:59:35 2021] GET /compute/v2.1/servers/cb93b585-b24f-444e-851a-98f0f13de9b2 => generated 1215 bytes in 1261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 04:59:36.900350 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-f45d4a28-cef0-499f-8912-07f491429913 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628d846121a14be78329ccc727c8869d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa473e12960449bbb0713a709e0abe4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 04:59:36.934889 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-f45d4a28-cef0-499f-8912-07f491429913 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] 10.222.0.47 "GET /compute/v2.1/servers/9b43c13a-0c7e-45d7-96b0-83fe593a8b08" status: 200 len: 1217 microversion: 2.1 time: 0.357927 Feb 19 04:59:36.957484 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 14/32] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 04:59:36 2021] GET /compute/v2.1/servers/9b43c13a-0c7e-45d7-96b0-83fe593a8b08 => generated 1217 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 04:59:37.255526 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-fbb0ca3c-acfc-493c-9120-1845a4fb1dd4 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Action: 'create', calling method: .version_select at 0x7f270840c510>, body: {"keypair": {"name": "tempest-keypair-2097827461"}} {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 04:59:37.562224 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.quota [None req-fbb0ca3c-acfc-493c-9120-1845a4fb1dd4 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Getting quotas for project 2441d2c3fda643489d511f8ba26e9755. Resources: {'key_pairs'} {{(pid=98154) _get_quotas /opt/stack/nova/nova/quota.py:388}} Feb 19 04:59:37.580580 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.quota [None req-fbb0ca3c-acfc-493c-9120-1845a4fb1dd4 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Getting quotas for user 62fa02eb0f4e42b3a536230807e2786d and project 2441d2c3fda643489d511f8ba26e9755. Resources: {'key_pairs'} {{(pid=98154) _get_quotas /opt/stack/nova/nova/quota.py:380}} Feb 19 04:59:37.730403 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-9aac3daf-b0cf-4fb9-9bda-b8bcd6180f7c tempest-DeleteServersTestJSON-1855409151 tempest-DeleteServersTestJSON-1855409151-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 04:59:37.760767 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-9aac3daf-b0cf-4fb9-9bda-b8bcd6180f7c tempest-DeleteServersTestJSON-1855409151 tempest-DeleteServersTestJSON-1855409151-project] [instance: cb93b585-b24f-444e-851a-98f0f13de9b2] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 04:59:38.363141 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.quota [None req-fbb0ca3c-acfc-493c-9120-1845a4fb1dd4 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Getting quotas for project 2441d2c3fda643489d511f8ba26e9755. Resources: {'key_pairs'} {{(pid=98154) _get_quotas /opt/stack/nova/nova/quota.py:388}} Feb 19 04:59:38.371731 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.quota [None req-fbb0ca3c-acfc-493c-9120-1845a4fb1dd4 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Getting quotas for user 62fa02eb0f4e42b3a536230807e2786d and project 2441d2c3fda643489d511f8ba26e9755. Resources: {'key_pairs'} {{(pid=98154) _get_quotas /opt/stack/nova/nova/quota.py:380}} Feb 19 04:59:38.391696 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-fbb0ca3c-acfc-493c-9120-1845a4fb1dd4 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 201 len: 2316 microversion: 2.20 time: 1.347479 Feb 19 04:59:38.392378 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 19/33] 10.222.0.47 () {62 vars in 1189 bytes} [Fri Feb 19 04:59:37 2021] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 1350 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Feb 19 04:59:38.399353 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-893e867b-fd2e-43fc-9e33-2d33a9258010 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 04:59:38.400215 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-893e867b-fd2e-43fc-9e33-2d33a9258010 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] [instance: 9b43c13a-0c7e-45d7-96b0-83fe593a8b08] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 04:59:38.470602 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-9aac3daf-b0cf-4fb9-9bda-b8bcd6180f7c tempest-DeleteServersTestJSON-1855409151 tempest-DeleteServersTestJSON-1855409151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbe79c8c7e046b28563ce75526c5554', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0703bf302bd646109e79f0f89f8938cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 04:59:38.509492 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-9aac3daf-b0cf-4fb9-9bda-b8bcd6180f7c tempest-DeleteServersTestJSON-1855409151 tempest-DeleteServersTestJSON-1855409151-project] 10.222.0.47 "GET /compute/v2.1/servers/cb93b585-b24f-444e-851a-98f0f13de9b2" status: 200 len: 1215 microversion: 2.1 time: 0.792636 Feb 19 04:59:38.517656 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 15/34] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 04:59:37 2021] GET /compute/v2.1/servers/cb93b585-b24f-444e-851a-98f0f13de9b2 => generated 1215 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 04:59:38.887210 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-893e867b-fd2e-43fc-9e33-2d33a9258010 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628d846121a14be78329ccc727c8869d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa473e12960449bbb0713a709e0abe4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 04:59:38.902435 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-893e867b-fd2e-43fc-9e33-2d33a9258010 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] 10.222.0.47 "GET /compute/v2.1/servers/9b43c13a-0c7e-45d7-96b0-83fe593a8b08" status: 200 len: 1217 microversion: 2.1 time: 0.508706 Feb 19 04:59:38.927227 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 20/35] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 04:59:38 2021] GET /compute/v2.1/servers/9b43c13a-0c7e-45d7-96b0-83fe593a8b08 => generated 1217 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 04:59:39.535078 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-71f2814d-6c4e-4cca-b2a0-2a945aa50b61 tempest-DeleteServersTestJSON-1855409151 tempest-DeleteServersTestJSON-1855409151-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 04:59:39.535796 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-71f2814d-6c4e-4cca-b2a0-2a945aa50b61 tempest-DeleteServersTestJSON-1855409151 tempest-DeleteServersTestJSON-1855409151-project] [instance: cb93b585-b24f-444e-851a-98f0f13de9b2] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 04:59:39.558423 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-71f2814d-6c4e-4cca-b2a0-2a945aa50b61 tempest-DeleteServersTestJSON-1855409151 tempest-DeleteServersTestJSON-1855409151-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 04:59:39.569823 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-71f2814d-6c4e-4cca-b2a0-2a945aa50b61 tempest-DeleteServersTestJSON-1855409151 tempest-DeleteServersTestJSON-1855409151-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 04:59:39.572953 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-71f2814d-6c4e-4cca-b2a0-2a945aa50b61 tempest-DeleteServersTestJSON-1855409151 tempest-DeleteServersTestJSON-1855409151-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 04:59:39.574688 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-71f2814d-6c4e-4cca-b2a0-2a945aa50b61 tempest-DeleteServersTestJSON-1855409151 tempest-DeleteServersTestJSON-1855409151-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 04:59:39.878691 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-12df554b-6cb2-4956-bca0-f0caa0bff58f tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-24140818", "imageRef": "53cdf9de-e495-4ca8-845f-6be2bf32cecb", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e33e2e15-66fc-4a94-b00e-9a912b6116fd"}]}} {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 04:59:40.218207 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.network.neutron [None req-12df554b-6cb2-4956-bca0-f0caa0bff58f tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] validate_networks() for [('e33e2e15-66fc-4a94-b00e-9a912b6116fd', None, None, None)] {{(pid=98153) validate_networks /opt/stack/nova/nova/network/neutron.py:2345}} Feb 19 04:59:40.336973 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-71f2814d-6c4e-4cca-b2a0-2a945aa50b61 tempest-DeleteServersTestJSON-1855409151 tempest-DeleteServersTestJSON-1855409151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbe79c8c7e046b28563ce75526c5554', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0703bf302bd646109e79f0f89f8938cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 04:59:40.370166 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-71f2814d-6c4e-4cca-b2a0-2a945aa50b61 tempest-DeleteServersTestJSON-1855409151 tempest-DeleteServersTestJSON-1855409151-project] 10.222.0.47 "GET /compute/v2.1/servers/cb93b585-b24f-444e-851a-98f0f13de9b2" status: 200 len: 1219 microversion: 2.1 time: 0.839229 Feb 19 04:59:40.380297 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 21/36] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 04:59:39 2021] GET /compute/v2.1/servers/cb93b585-b24f-444e-851a-98f0f13de9b2 => generated 1219 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 04:59:40.390645 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-22b0f5b6-f25d-43b3-8785-886aadf6ffcb tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 04:59:40.411545 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-22b0f5b6-f25d-43b3-8785-886aadf6ffcb tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] [instance: 9b43c13a-0c7e-45d7-96b0-83fe593a8b08] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 04:59:40.463384 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-22b0f5b6-f25d-43b3-8785-886aadf6ffcb tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 04:59:40.464590 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-22b0f5b6-f25d-43b3-8785-886aadf6ffcb tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 04:59:40.466387 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-22b0f5b6-f25d-43b3-8785-886aadf6ffcb tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 04:59:40.467540 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-22b0f5b6-f25d-43b3-8785-886aadf6ffcb tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 04:59:41.943590 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-22b0f5b6-f25d-43b3-8785-886aadf6ffcb tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628d846121a14be78329ccc727c8869d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa473e12960449bbb0713a709e0abe4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 04:59:41.966184 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-22b0f5b6-f25d-43b3-8785-886aadf6ffcb tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] 10.222.0.47 "GET /compute/v2.1/servers/9b43c13a-0c7e-45d7-96b0-83fe593a8b08" status: 200 len: 1269 microversion: 2.1 time: 1.580033 Feb 19 04:59:41.980965 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 22/37] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 04:59:40 2021] GET /compute/v2.1/servers/9b43c13a-0c7e-45d7-96b0-83fe593a8b08 => generated 1269 bytes in 1600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 04:59:41.987552 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-bc0f3b51-fb3d-4111-98a1-4e57a7a0265f tempest-DeleteServersTestJSON-1855409151 tempest-DeleteServersTestJSON-1855409151-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 04:59:41.988465 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-bc0f3b51-fb3d-4111-98a1-4e57a7a0265f tempest-DeleteServersTestJSON-1855409151 tempest-DeleteServersTestJSON-1855409151-project] [instance: cb93b585-b24f-444e-851a-98f0f13de9b2] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 04:59:42.011488 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-bc0f3b51-fb3d-4111-98a1-4e57a7a0265f tempest-DeleteServersTestJSON-1855409151 tempest-DeleteServersTestJSON-1855409151-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 04:59:42.012343 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-bc0f3b51-fb3d-4111-98a1-4e57a7a0265f tempest-DeleteServersTestJSON-1855409151 tempest-DeleteServersTestJSON-1855409151-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 04:59:42.013419 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-bc0f3b51-fb3d-4111-98a1-4e57a7a0265f tempest-DeleteServersTestJSON-1855409151 tempest-DeleteServersTestJSON-1855409151-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 04:59:42.014192 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-bc0f3b51-fb3d-4111-98a1-4e57a7a0265f tempest-DeleteServersTestJSON-1855409151 tempest-DeleteServersTestJSON-1855409151-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 04:59:43.043301 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-bc0f3b51-fb3d-4111-98a1-4e57a7a0265f tempest-DeleteServersTestJSON-1855409151 tempest-DeleteServersTestJSON-1855409151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbe79c8c7e046b28563ce75526c5554', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0703bf302bd646109e79f0f89f8938cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 04:59:43.059930 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-bc0f3b51-fb3d-4111-98a1-4e57a7a0265f tempest-DeleteServersTestJSON-1855409151 tempest-DeleteServersTestJSON-1855409151-project] 10.222.0.47 "GET /compute/v2.1/servers/cb93b585-b24f-444e-851a-98f0f13de9b2" status: 200 len: 1275 microversion: 2.1 time: 1.077240 Feb 19 04:59:43.064656 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 23/38] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 04:59:41 2021] GET /compute/v2.1/servers/cb93b585-b24f-444e-851a-98f0f13de9b2 => generated 1275 bytes in 1083 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 04:59:43.083410 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-f8a06b3c-6f26-4837-b7b1-d01d55d054c8 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 04:59:43.088393 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-f8a06b3c-6f26-4837-b7b1-d01d55d054c8 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] [instance: 9b43c13a-0c7e-45d7-96b0-83fe593a8b08] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 04:59:43.115069 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-f8a06b3c-6f26-4837-b7b1-d01d55d054c8 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 04:59:43.122516 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-f8a06b3c-6f26-4837-b7b1-d01d55d054c8 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 04:59:43.123582 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-f8a06b3c-6f26-4837-b7b1-d01d55d054c8 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 04:59:43.135788 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-f8a06b3c-6f26-4837-b7b1-d01d55d054c8 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 04:59:43.741359 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-f8a06b3c-6f26-4837-b7b1-d01d55d054c8 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628d846121a14be78329ccc727c8869d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa473e12960449bbb0713a709e0abe4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 04:59:43.762369 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-f8a06b3c-6f26-4837-b7b1-d01d55d054c8 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] 10.222.0.47 "GET /compute/v2.1/servers/9b43c13a-0c7e-45d7-96b0-83fe593a8b08" status: 200 len: 1275 microversion: 2.1 time: 0.696076 Feb 19 04:59:43.771072 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 24/39] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 04:59:43 2021] GET /compute/v2.1/servers/9b43c13a-0c7e-45d7-96b0-83fe593a8b08 => generated 1275 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 04:59:44.102567 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-5ac2b3a3-97f3-43c3-8220-f0176f62ba84 tempest-DeleteServersTestJSON-1855409151 tempest-DeleteServersTestJSON-1855409151-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 04:59:44.104259 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-5ac2b3a3-97f3-43c3-8220-f0176f62ba84 tempest-DeleteServersTestJSON-1855409151 tempest-DeleteServersTestJSON-1855409151-project] [instance: cb93b585-b24f-444e-851a-98f0f13de9b2] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 04:59:44.179573 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-5ac2b3a3-97f3-43c3-8220-f0176f62ba84 tempest-DeleteServersTestJSON-1855409151 tempest-DeleteServersTestJSON-1855409151-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 04:59:44.182871 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-5ac2b3a3-97f3-43c3-8220-f0176f62ba84 tempest-DeleteServersTestJSON-1855409151 tempest-DeleteServersTestJSON-1855409151-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 04:59:44.192354 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-5ac2b3a3-97f3-43c3-8220-f0176f62ba84 tempest-DeleteServersTestJSON-1855409151 tempest-DeleteServersTestJSON-1855409151-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 04:59:44.193879 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-5ac2b3a3-97f3-43c3-8220-f0176f62ba84 tempest-DeleteServersTestJSON-1855409151 tempest-DeleteServersTestJSON-1855409151-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 04:59:44.591019 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-5ac2b3a3-97f3-43c3-8220-f0176f62ba84 tempest-DeleteServersTestJSON-1855409151 tempest-DeleteServersTestJSON-1855409151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbe79c8c7e046b28563ce75526c5554', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0703bf302bd646109e79f0f89f8938cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 04:59:44.613969 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-5ac2b3a3-97f3-43c3-8220-f0176f62ba84 tempest-DeleteServersTestJSON-1855409151 tempest-DeleteServersTestJSON-1855409151-project] 10.222.0.47 "GET /compute/v2.1/servers/cb93b585-b24f-444e-851a-98f0f13de9b2" status: 200 len: 1273 microversion: 2.1 time: 0.520125 Feb 19 04:59:44.614969 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 25/40] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 04:59:44 2021] GET /compute/v2.1/servers/cb93b585-b24f-444e-851a-98f0f13de9b2 => generated 1273 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 04:59:44.790902 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-512338ef-b32a-4463-8c09-066c173c8431 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 04:59:44.793974 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-512338ef-b32a-4463-8c09-066c173c8431 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] [instance: 9b43c13a-0c7e-45d7-96b0-83fe593a8b08] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 04:59:44.814418 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-512338ef-b32a-4463-8c09-066c173c8431 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 04:59:44.817807 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-512338ef-b32a-4463-8c09-066c173c8431 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 04:59:44.819788 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-512338ef-b32a-4463-8c09-066c173c8431 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 04:59:44.823004 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-512338ef-b32a-4463-8c09-066c173c8431 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 04:59:45.730945 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-512338ef-b32a-4463-8c09-066c173c8431 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628d846121a14be78329ccc727c8869d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa473e12960449bbb0713a709e0abe4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 04:59:45.760433 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-512338ef-b32a-4463-8c09-066c173c8431 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] 10.222.0.47 "GET /compute/v2.1/servers/9b43c13a-0c7e-45d7-96b0-83fe593a8b08" status: 200 len: 1275 microversion: 2.1 time: 0.965948 Feb 19 04:59:45.776177 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 26/41] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 04:59:44 2021] GET /compute/v2.1/servers/9b43c13a-0c7e-45d7-96b0-83fe593a8b08 => generated 1275 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 04:59:45.797173 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-c87679de-d8ae-4390-b0f9-e83398843806 tempest-DeleteServersTestJSON-1855409151 tempest-DeleteServersTestJSON-1855409151-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 04:59:45.807155 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-c87679de-d8ae-4390-b0f9-e83398843806 tempest-DeleteServersTestJSON-1855409151 tempest-DeleteServersTestJSON-1855409151-project] [instance: cb93b585-b24f-444e-851a-98f0f13de9b2] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 04:59:45.828394 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-c87679de-d8ae-4390-b0f9-e83398843806 tempest-DeleteServersTestJSON-1855409151 tempest-DeleteServersTestJSON-1855409151-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 04:59:45.833940 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-c87679de-d8ae-4390-b0f9-e83398843806 tempest-DeleteServersTestJSON-1855409151 tempest-DeleteServersTestJSON-1855409151-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 04:59:45.838004 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-c87679de-d8ae-4390-b0f9-e83398843806 tempest-DeleteServersTestJSON-1855409151 tempest-DeleteServersTestJSON-1855409151-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 04:59:45.839247 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-c87679de-d8ae-4390-b0f9-e83398843806 tempest-DeleteServersTestJSON-1855409151 tempest-DeleteServersTestJSON-1855409151-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 04:59:46.358884 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-c87679de-d8ae-4390-b0f9-e83398843806 tempest-DeleteServersTestJSON-1855409151 tempest-DeleteServersTestJSON-1855409151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbe79c8c7e046b28563ce75526c5554', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0703bf302bd646109e79f0f89f8938cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 04:59:46.388356 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-c87679de-d8ae-4390-b0f9-e83398843806 tempest-DeleteServersTestJSON-1855409151 tempest-DeleteServersTestJSON-1855409151-project] 10.222.0.47 "GET /compute/v2.1/servers/cb93b585-b24f-444e-851a-98f0f13de9b2" status: 200 len: 1273 microversion: 2.1 time: 0.607593 Feb 19 04:59:46.389494 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 27/42] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 04:59:45 2021] GET /compute/v2.1/servers/cb93b585-b24f-444e-851a-98f0f13de9b2 => generated 1273 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 04:59:46.780031 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-075a8603-143b-4252-84cf-dc2e35b0f2a4 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 04:59:46.780806 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-075a8603-143b-4252-84cf-dc2e35b0f2a4 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] [instance: 9b43c13a-0c7e-45d7-96b0-83fe593a8b08] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 04:59:46.796424 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-075a8603-143b-4252-84cf-dc2e35b0f2a4 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 04:59:46.800578 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-075a8603-143b-4252-84cf-dc2e35b0f2a4 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 04:59:46.804380 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-075a8603-143b-4252-84cf-dc2e35b0f2a4 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 04:59:46.808678 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-075a8603-143b-4252-84cf-dc2e35b0f2a4 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 04:59:47.160124 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.virt.hardware [None req-12df554b-6cb2-4956-bca0-f0caa0bff58f tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Flavor limits 0:0:0 {{(pid=98153) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 19 04:59:47.160930 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.virt.hardware [None req-12df554b-6cb2-4956-bca0-f0caa0bff58f tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Image limits 0:0:0 {{(pid=98153) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Feb 19 04:59:47.162036 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.virt.hardware [None req-12df554b-6cb2-4956-bca0-f0caa0bff58f tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Flavor pref 0:0:0 {{(pid=98153) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 19 04:59:47.162842 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.virt.hardware [None req-12df554b-6cb2-4956-bca0-f0caa0bff58f tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Image pref 0:0:0 {{(pid=98153) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Feb 19 04:59:47.163528 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.virt.hardware [None req-12df554b-6cb2-4956-bca0-f0caa0bff58f tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98153) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Feb 19 04:59:47.207450 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-12df554b-6cb2-4956-bca0-f0caa0bff58f tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 04:59:47.213377 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-12df554b-6cb2-4956-bca0-f0caa0bff58f tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 04:59:47.214993 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-12df554b-6cb2-4956-bca0-f0caa0bff58f tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 04:59:47.220284 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-12df554b-6cb2-4956-bca0-f0caa0bff58f tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 04:59:47.340232 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.quota [None req-12df554b-6cb2-4956-bca0-f0caa0bff58f tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Getting quotas for project 2ee9a43087d5497da3af9fbf68c4572d. Resources: {'instances', 'ram', 'cores'} {{(pid=98153) _get_quotas /opt/stack/nova/nova/quota.py:388}} Feb 19 04:59:47.358443 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.quota [None req-12df554b-6cb2-4956-bca0-f0caa0bff58f tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Getting quotas for user 24af0562e2aa43ca9d601be5e16fe9cc and project 2ee9a43087d5497da3af9fbf68c4572d. Resources: {'instances', 'ram', 'cores'} {{(pid=98153) _get_quotas /opt/stack/nova/nova/quota.py:380}} Feb 19 04:59:47.389204 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-12df554b-6cb2-4956-bca0-f0caa0bff58f tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Going to run 1 instances... {{(pid=98153) _provision_instances /opt/stack/nova/nova/compute/api.py:1264}} Feb 19 04:59:47.399194 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-12df554b-6cb2-4956-bca0-f0caa0bff58f tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] [instance: 74c5a115-b174-49fe-9b75-574e484a09e2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='53cdf9de-e495-4ca8-845f-6be2bf32cecb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98153) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1666}} Feb 19 04:59:47.565273 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-12df554b-6cb2-4956-bca0-f0caa0bff58f tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 8.254023 Feb 19 04:59:47.572881 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 16/43] 10.222.0.47 () {60 vars in 1137 bytes} [Fri Feb 19 04:59:39 2021] POST /compute/v2.1/servers => generated 383 bytes in 8263 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 19 04:59:47.578644 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-78f3a1fa-227c-40ee-868a-49a76e11fa20 tempest-DeleteServersTestJSON-1855409151 tempest-DeleteServersTestJSON-1855409151-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 04:59:47.589142 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-78f3a1fa-227c-40ee-868a-49a76e11fa20 tempest-DeleteServersTestJSON-1855409151 tempest-DeleteServersTestJSON-1855409151-project] [instance: cb93b585-b24f-444e-851a-98f0f13de9b2] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 04:59:47.629924 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-78f3a1fa-227c-40ee-868a-49a76e11fa20 tempest-DeleteServersTestJSON-1855409151 tempest-DeleteServersTestJSON-1855409151-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 04:59:47.635930 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-78f3a1fa-227c-40ee-868a-49a76e11fa20 tempest-DeleteServersTestJSON-1855409151 tempest-DeleteServersTestJSON-1855409151-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 04:59:47.640098 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-78f3a1fa-227c-40ee-868a-49a76e11fa20 tempest-DeleteServersTestJSON-1855409151 tempest-DeleteServersTestJSON-1855409151-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 04:59:47.646023 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-78f3a1fa-227c-40ee-868a-49a76e11fa20 tempest-DeleteServersTestJSON-1855409151 tempest-DeleteServersTestJSON-1855409151-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 04:59:49.221501 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-78f3a1fa-227c-40ee-868a-49a76e11fa20 tempest-DeleteServersTestJSON-1855409151 tempest-DeleteServersTestJSON-1855409151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbe79c8c7e046b28563ce75526c5554', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0703bf302bd646109e79f0f89f8938cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 04:59:49.306131 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-78f3a1fa-227c-40ee-868a-49a76e11fa20 tempest-DeleteServersTestJSON-1855409151 tempest-DeleteServersTestJSON-1855409151-project] 10.222.0.47 "GET /compute/v2.1/servers/cb93b585-b24f-444e-851a-98f0f13de9b2" status: 200 len: 1273 microversion: 2.1 time: 1.731096 Feb 19 04:59:49.328480 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 17/44] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 04:59:47 2021] GET /compute/v2.1/servers/cb93b585-b24f-444e-851a-98f0f13de9b2 => generated 1273 bytes in 1755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 04:59:49.373453 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-20c3c7f9-97cf-482a-98c7-41eb46d327be tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 04:59:49.375412 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-20c3c7f9-97cf-482a-98c7-41eb46d327be tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] [instance: 74c5a115-b174-49fe-9b75-574e484a09e2] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 04:59:49.448640 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-20c3c7f9-97cf-482a-98c7-41eb46d327be tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 04:59:49.461876 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-20c3c7f9-97cf-482a-98c7-41eb46d327be tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 04:59:49.463912 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-20c3c7f9-97cf-482a-98c7-41eb46d327be tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 04:59:49.464892 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-20c3c7f9-97cf-482a-98c7-41eb46d327be tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 04:59:49.735854 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-075a8603-143b-4252-84cf-dc2e35b0f2a4 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628d846121a14be78329ccc727c8869d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa473e12960449bbb0713a709e0abe4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 04:59:49.784724 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-075a8603-143b-4252-84cf-dc2e35b0f2a4 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] 10.222.0.47 "GET /compute/v2.1/servers/9b43c13a-0c7e-45d7-96b0-83fe593a8b08" status: 200 len: 1275 microversion: 2.1 time: 3.008554 Feb 19 04:59:49.796877 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 28/45] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 04:59:46 2021] GET /compute/v2.1/servers/9b43c13a-0c7e-45d7-96b0-83fe593a8b08 => generated 1275 bytes in 3022 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 04:59:50.351177 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-734741dc-4db1-49d3-a0f7-6beeb462126a tempest-DeleteServersTestJSON-1855409151 tempest-DeleteServersTestJSON-1855409151-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 04:59:50.352397 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-734741dc-4db1-49d3-a0f7-6beeb462126a tempest-DeleteServersTestJSON-1855409151 tempest-DeleteServersTestJSON-1855409151-project] [instance: cb93b585-b24f-444e-851a-98f0f13de9b2] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 04:59:50.408214 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-734741dc-4db1-49d3-a0f7-6beeb462126a tempest-DeleteServersTestJSON-1855409151 tempest-DeleteServersTestJSON-1855409151-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 04:59:50.416664 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-734741dc-4db1-49d3-a0f7-6beeb462126a tempest-DeleteServersTestJSON-1855409151 tempest-DeleteServersTestJSON-1855409151-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 04:59:50.418621 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-734741dc-4db1-49d3-a0f7-6beeb462126a tempest-DeleteServersTestJSON-1855409151 tempest-DeleteServersTestJSON-1855409151-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 04:59:50.424693 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-734741dc-4db1-49d3-a0f7-6beeb462126a tempest-DeleteServersTestJSON-1855409151 tempest-DeleteServersTestJSON-1855409151-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 04:59:50.735544 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-20c3c7f9-97cf-482a-98c7-41eb46d327be tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24af0562e2aa43ca9d601be5e16fe9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ee9a43087d5497da3af9fbf68c4572d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 04:59:50.777024 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-20c3c7f9-97cf-482a-98c7-41eb46d327be tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] 10.222.0.47 "GET /compute/v2.1/servers/74c5a115-b174-49fe-9b75-574e484a09e2" status: 200 len: 1224 microversion: 2.1 time: 1.440740 Feb 19 04:59:50.789068 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 18/46] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 04:59:49 2021] GET /compute/v2.1/servers/74c5a115-b174-49fe-9b75-574e484a09e2 => generated 1224 bytes in 1457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 04:59:50.841201 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-22451251-e907-4a74-94e5-2b3e4ad61e64 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 04:59:50.845792 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-22451251-e907-4a74-94e5-2b3e4ad61e64 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] [instance: 9b43c13a-0c7e-45d7-96b0-83fe593a8b08] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 04:59:50.883539 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-22451251-e907-4a74-94e5-2b3e4ad61e64 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 04:59:50.890343 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-22451251-e907-4a74-94e5-2b3e4ad61e64 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 04:59:50.892698 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-22451251-e907-4a74-94e5-2b3e4ad61e64 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 04:59:50.893789 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-22451251-e907-4a74-94e5-2b3e4ad61e64 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 04:59:52.510402 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-22451251-e907-4a74-94e5-2b3e4ad61e64 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628d846121a14be78329ccc727c8869d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa473e12960449bbb0713a709e0abe4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 04:59:52.524329 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-22451251-e907-4a74-94e5-2b3e4ad61e64 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] 10.222.0.47 "GET /compute/v2.1/servers/9b43c13a-0c7e-45d7-96b0-83fe593a8b08" status: 200 len: 1317 microversion: 2.1 time: 1.692798 Feb 19 04:59:52.546400 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 19/47] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 04:59:50 2021] GET /compute/v2.1/servers/9b43c13a-0c7e-45d7-96b0-83fe593a8b08 => generated 1317 bytes in 1713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 04:59:52.569936 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-6427ff07-aa92-4887-862e-0aea7509f8c4 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-278183472", "imageRef": "53cdf9de-e495-4ca8-845f-6be2bf32cecb", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e33e2e15-66fc-4a94-b00e-9a912b6116fd"}]}} {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 04:59:52.697616 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-734741dc-4db1-49d3-a0f7-6beeb462126a tempest-DeleteServersTestJSON-1855409151 tempest-DeleteServersTestJSON-1855409151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbe79c8c7e046b28563ce75526c5554', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0703bf302bd646109e79f0f89f8938cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 04:59:52.735137 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-734741dc-4db1-49d3-a0f7-6beeb462126a tempest-DeleteServersTestJSON-1855409151 tempest-DeleteServersTestJSON-1855409151-project] 10.222.0.47 "GET /compute/v2.1/servers/cb93b585-b24f-444e-851a-98f0f13de9b2" status: 200 len: 1315 microversion: 2.1 time: 2.384156 Feb 19 04:59:52.748942 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 29/48] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 04:59:50 2021] GET /compute/v2.1/servers/cb93b585-b24f-444e-851a-98f0f13de9b2 => generated 1315 bytes in 2407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 04:59:52.790424 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-31d05ed7-26c8-48dd-b5b8-318a3275f4ac tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1704765576", "imageRef": "53cdf9de-e495-4ca8-845f-6be2bf32cecb", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f2977b0e-aa44-47dc-b320-3e70742849f6"}], "security_groups": [{"name": "tempest-securitygroup--1112900768"}], "key_name": "tempest-keypair-2097827461", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:00:04.011166 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.network.neutron [None req-6427ff07-aa92-4887-862e-0aea7509f8c4 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] validate_networks() for [('e33e2e15-66fc-4a94-b00e-9a912b6116fd', None, None, None)] {{(pid=98153) validate_networks /opt/stack/nova/nova/network/neutron.py:2345}} Feb 19 05:00:04.446163 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.network.neutron [None req-31d05ed7-26c8-48dd-b5b8-318a3275f4ac tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] validate_networks() for [('f2977b0e-aa44-47dc-b320-3e70742849f6', None, None, None)] {{(pid=98154) validate_networks /opt/stack/nova/nova/network/neutron.py:2345}} Feb 19 05:00:06.886538 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.virt.hardware [None req-6427ff07-aa92-4887-862e-0aea7509f8c4 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Flavor limits 0:0:0 {{(pid=98153) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 19 05:00:06.887390 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.virt.hardware [None req-6427ff07-aa92-4887-862e-0aea7509f8c4 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Image limits 0:0:0 {{(pid=98153) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Feb 19 05:00:06.888500 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.virt.hardware [None req-6427ff07-aa92-4887-862e-0aea7509f8c4 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Flavor pref 0:0:0 {{(pid=98153) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 19 05:00:06.889388 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.virt.hardware [None req-6427ff07-aa92-4887-862e-0aea7509f8c4 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Image pref 0:0:0 {{(pid=98153) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Feb 19 05:00:06.890475 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.virt.hardware [None req-6427ff07-aa92-4887-862e-0aea7509f8c4 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98153) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Feb 19 05:00:06.907546 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-6427ff07-aa92-4887-862e-0aea7509f8c4 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:00:06.908971 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-6427ff07-aa92-4887-862e-0aea7509f8c4 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:00:06.911283 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-6427ff07-aa92-4887-862e-0aea7509f8c4 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:00:06.913800 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-6427ff07-aa92-4887-862e-0aea7509f8c4 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:00:06.950116 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.quota [None req-6427ff07-aa92-4887-862e-0aea7509f8c4 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Getting quotas for project 2ee9a43087d5497da3af9fbf68c4572d. Resources: {'instances', 'ram', 'cores'} {{(pid=98153) _get_quotas /opt/stack/nova/nova/quota.py:388}} Feb 19 05:00:06.958365 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.quota [None req-6427ff07-aa92-4887-862e-0aea7509f8c4 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Getting quotas for user 24af0562e2aa43ca9d601be5e16fe9cc and project 2ee9a43087d5497da3af9fbf68c4572d. Resources: {'instances', 'ram', 'cores'} {{(pid=98153) _get_quotas /opt/stack/nova/nova/quota.py:380}} Feb 19 05:00:06.982342 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-6427ff07-aa92-4887-862e-0aea7509f8c4 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Going to run 1 instances... {{(pid=98153) _provision_instances /opt/stack/nova/nova/compute/api.py:1264}} Feb 19 05:00:06.988974 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-6427ff07-aa92-4887-862e-0aea7509f8c4 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] [instance: c74e760d-0b53-4508-ae21-494989132c3a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='53cdf9de-e495-4ca8-845f-6be2bf32cecb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98153) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1666}} Feb 19 05:00:07.123175 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-6427ff07-aa92-4887-862e-0aea7509f8c4 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 14.577388 Feb 19 05:00:07.124500 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 20/49] 10.222.0.47 () {60 vars in 1137 bytes} [Fri Feb 19 04:59:52 2021] POST /compute/v2.1/servers => generated 383 bytes in 14580 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 19 05:00:07.138864 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-3090afc9-f91b-4514-8938-9b8afce6e7f3 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:00:07.156526 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-3090afc9-f91b-4514-8938-9b8afce6e7f3 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] [instance: 9b43c13a-0c7e-45d7-96b0-83fe593a8b08] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:00:07.180457 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-3090afc9-f91b-4514-8938-9b8afce6e7f3 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:00:07.181326 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-3090afc9-f91b-4514-8938-9b8afce6e7f3 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:00:07.182884 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-3090afc9-f91b-4514-8938-9b8afce6e7f3 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:00:07.188809 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.virt.hardware [None req-31d05ed7-26c8-48dd-b5b8-318a3275f4ac tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Flavor limits 0:0:0 {{(pid=98154) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 19 05:00:07.190193 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.virt.hardware [None req-31d05ed7-26c8-48dd-b5b8-318a3275f4ac tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Image limits 0:0:0 {{(pid=98154) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Feb 19 05:00:07.190562 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.virt.hardware [None req-31d05ed7-26c8-48dd-b5b8-318a3275f4ac tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Flavor pref 0:0:0 {{(pid=98154) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 19 05:00:07.192147 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.virt.hardware [None req-31d05ed7-26c8-48dd-b5b8-318a3275f4ac tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Image pref 0:0:0 {{(pid=98154) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Feb 19 05:00:07.193044 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.virt.hardware [None req-31d05ed7-26c8-48dd-b5b8-318a3275f4ac tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98154) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Feb 19 05:00:07.204802 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-3090afc9-f91b-4514-8938-9b8afce6e7f3 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:00:07.231528 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-31d05ed7-26c8-48dd-b5b8-318a3275f4ac tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:00:07.232470 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-31d05ed7-26c8-48dd-b5b8-318a3275f4ac tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:00:07.234041 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-31d05ed7-26c8-48dd-b5b8-318a3275f4ac tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:00:07.235281 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-31d05ed7-26c8-48dd-b5b8-318a3275f4ac tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:00:07.312070 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.quota [None req-31d05ed7-26c8-48dd-b5b8-318a3275f4ac tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Getting quotas for project 2441d2c3fda643489d511f8ba26e9755. Resources: {'instances', 'ram', 'cores'} {{(pid=98154) _get_quotas /opt/stack/nova/nova/quota.py:388}} Feb 19 05:00:07.335540 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.quota [None req-31d05ed7-26c8-48dd-b5b8-318a3275f4ac tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Getting quotas for user 62fa02eb0f4e42b3a536230807e2786d and project 2441d2c3fda643489d511f8ba26e9755. Resources: {'instances', 'ram', 'cores'} {{(pid=98154) _get_quotas /opt/stack/nova/nova/quota.py:380}} Feb 19 05:00:07.377446 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-31d05ed7-26c8-48dd-b5b8-318a3275f4ac tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Going to run 1 instances... {{(pid=98154) _provision_instances /opt/stack/nova/nova/compute/api.py:1264}} Feb 19 05:00:07.390052 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-31d05ed7-26c8-48dd-b5b8-318a3275f4ac tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] [instance: 798b77ff-c3ca-4c65-a120-db12ad953621] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='53cdf9de-e495-4ca8-845f-6be2bf32cecb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98154) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1666}} Feb 19 05:00:07.594921 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-31d05ed7-26c8-48dd-b5b8-318a3275f4ac tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 14.843526 Feb 19 05:00:07.614769 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 30/50] 10.222.0.47 () {62 vars in 1178 bytes} [Fri Feb 19 04:59:52 2021] POST /compute/v2.1/servers => generated 402 bytes in 14865 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Feb 19 05:00:07.626941 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-784f85a8-baa2-4835-bbee-6e6bf890c3ac tempest-DeleteServersTestJSON-1855409151 tempest-DeleteServersTestJSON-1855409151-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:00:07.628235 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-784f85a8-baa2-4835-bbee-6e6bf890c3ac tempest-DeleteServersTestJSON-1855409151 tempest-DeleteServersTestJSON-1855409151-project] [instance: cb93b585-b24f-444e-851a-98f0f13de9b2] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:00:07.667051 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-784f85a8-baa2-4835-bbee-6e6bf890c3ac tempest-DeleteServersTestJSON-1855409151 tempest-DeleteServersTestJSON-1855409151-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:00:07.667827 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-784f85a8-baa2-4835-bbee-6e6bf890c3ac tempest-DeleteServersTestJSON-1855409151 tempest-DeleteServersTestJSON-1855409151-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:00:07.669704 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-784f85a8-baa2-4835-bbee-6e6bf890c3ac tempest-DeleteServersTestJSON-1855409151 tempest-DeleteServersTestJSON-1855409151-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:00:07.670932 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-784f85a8-baa2-4835-bbee-6e6bf890c3ac tempest-DeleteServersTestJSON-1855409151 tempest-DeleteServersTestJSON-1855409151-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:00:07.907051 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-3090afc9-f91b-4514-8938-9b8afce6e7f3 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628d846121a14be78329ccc727c8869d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa473e12960449bbb0713a709e0abe4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:00:07.924896 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-3090afc9-f91b-4514-8938-9b8afce6e7f3 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] 10.222.0.47 "GET /compute/v2.1/servers/9b43c13a-0c7e-45d7-96b0-83fe593a8b08" status: 200 len: 1317 microversion: 2.1 time: 0.798368 Feb 19 05:00:07.934616 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 21/51] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:00:07 2021] GET /compute/v2.1/servers/9b43c13a-0c7e-45d7-96b0-83fe593a8b08 => generated 1317 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:00:08.157043 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-6f21c565-1a49-48df-aee9-6a6ba871b1bb tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Action: 'create', calling method: .version_select at 0x7f27083cb158>, body: {"keypair": {"name": "tempest-keypair-61000085"}} {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:00:08.238461 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.quota [None req-6f21c565-1a49-48df-aee9-6a6ba871b1bb tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Getting quotas for project e50941a0cab243e9a320ff22a7648de6. Resources: {'key_pairs'} {{(pid=98153) _get_quotas /opt/stack/nova/nova/quota.py:388}} Feb 19 05:00:08.247670 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.quota [None req-6f21c565-1a49-48df-aee9-6a6ba871b1bb tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Getting quotas for user 7a3274478c0a421895f43618dc827ea9 and project e50941a0cab243e9a320ff22a7648de6. Resources: {'key_pairs'} {{(pid=98153) _get_quotas /opt/stack/nova/nova/quota.py:380}} Feb 19 05:00:08.747024 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.quota [None req-6f21c565-1a49-48df-aee9-6a6ba871b1bb tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Getting quotas for project e50941a0cab243e9a320ff22a7648de6. Resources: {'key_pairs'} {{(pid=98153) _get_quotas /opt/stack/nova/nova/quota.py:388}} Feb 19 05:00:08.755531 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.quota [None req-6f21c565-1a49-48df-aee9-6a6ba871b1bb tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Getting quotas for user 7a3274478c0a421895f43618dc827ea9 and project e50941a0cab243e9a320ff22a7648de6. Resources: {'key_pairs'} {{(pid=98153) _get_quotas /opt/stack/nova/nova/quota.py:380}} Feb 19 05:00:08.783505 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-6f21c565-1a49-48df-aee9-6a6ba871b1bb tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 2299 microversion: 2.1 time: 0.846899 Feb 19 05:00:08.784738 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 22/52] 10.222.0.47 () {60 vars in 1148 bytes} [Fri Feb 19 05:00:07 2021] POST /compute/v2.1/os-keypairs => generated 2299 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:00:08.942155 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [req-3ae35b0c-fb9e-4599-a780-8df524218cd8 req-b1e5d776-481f-4634-8c35-017d2a431f0a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cb93b585-b24f-444e-851a-98f0f13de9b2", "tag": "42106eef-d038-443f-9ab2-92e08bef76ec"}]} {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:00:08.945142 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 05:00:08.945142 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: warnings.warn(msg) Feb 19 05:00:08.951251 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-784f85a8-baa2-4835-bbee-6e6bf890c3ac tempest-DeleteServersTestJSON-1855409151 tempest-DeleteServersTestJSON-1855409151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbe79c8c7e046b28563ce75526c5554', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0703bf302bd646109e79f0f89f8938cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:00:08.961049 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [req-3ae35b0c-fb9e-4599-a780-8df524218cd8 req-b1e5d776-481f-4634-8c35-017d2a431f0a service nova] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:00:08.961577 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [req-3ae35b0c-fb9e-4599-a780-8df524218cd8 req-b1e5d776-481f-4634-8c35-017d2a431f0a service nova] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:00:08.987390 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-784f85a8-baa2-4835-bbee-6e6bf890c3ac tempest-DeleteServersTestJSON-1855409151 tempest-DeleteServersTestJSON-1855409151-project] 10.222.0.47 "GET /compute/v2.1/servers/cb93b585-b24f-444e-851a-98f0f13de9b2" status: 200 len: 1315 microversion: 2.1 time: 1.357927 Feb 19 05:00:08.988372 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 31/53] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:00:07 2021] GET /compute/v2.1/servers/cb93b585-b24f-444e-851a-98f0f13de9b2 => generated 1315 bytes in 1373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:00:09.012995 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.compute.server_external_events [req-3ae35b0c-fb9e-4599-a780-8df524218cd8 req-b1e5d776-481f-4634-8c35-017d2a431f0a service nova] Creating event network-changed:42106eef-d038-443f-9ab2-92e08bef76ec for instance cb93b585-b24f-444e-851a-98f0f13de9b2 on hv-cinder-77642 Feb 19 05:00:09.013713 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [req-3ae35b0c-fb9e-4599-a780-8df524218cd8 req-b1e5d776-481f-4634-8c35-017d2a431f0a service nova] Acquired lock "compute-rpcapi-router" {{(pid=98153) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:266}} Feb 19 05:00:09.015254 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-96e31cf9-8829-4750-9c15-88fac365d31f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:00:09.016024 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-96e31cf9-8829-4750-9c15-88fac365d31f None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:00:09.017077 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-96e31cf9-8829-4750-9c15-88fac365d31f None None] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:00:09.017715 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-96e31cf9-8829-4750-9c15-88fac365d31f None None] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:00:09.031016 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.compute.rpcapi [None req-96e31cf9-8829-4750-9c15-88fac365d31f None None] Automatically selected compute RPC version 5.13 from minimum service version 54 Feb 19 05:00:09.032579 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-96e31cf9-8829-4750-9c15-88fac365d31f None None] Releasing lock "compute-rpcapi-router" {{(pid=98153) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:282}} Feb 19 05:00:09.061161 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-e536720a-3e66-4892-8b16-4c1d01b28987 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:00:09.062312 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-e536720a-3e66-4892-8b16-4c1d01b28987 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] [instance: c74e760d-0b53-4508-ae21-494989132c3a] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:00:09.077089 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-e536720a-3e66-4892-8b16-4c1d01b28987 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:00:09.086355 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-96e31cf9-8829-4750-9c15-88fac365d31f None None] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.297374 Feb 19 05:00:09.087746 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 23/54] 10.222.0.47 () {64 vars in 1308 bytes} [Fri Feb 19 05:00:08 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 05:00:09.094008 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-68ae0d8e-3108-4572-a8ed-bc189cc65628 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:00:09.094980 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-e536720a-3e66-4892-8b16-4c1d01b28987 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:00:09.104799 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-e536720a-3e66-4892-8b16-4c1d01b28987 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:00:09.106519 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-e536720a-3e66-4892-8b16-4c1d01b28987 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:00:09.107425 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-68ae0d8e-3108-4572-a8ed-bc189cc65628 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] [instance: 798b77ff-c3ca-4c65-a120-db12ad953621] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:00:09.133271 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-68ae0d8e-3108-4572-a8ed-bc189cc65628 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:00:09.136734 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-68ae0d8e-3108-4572-a8ed-bc189cc65628 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:00:09.144628 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-68ae0d8e-3108-4572-a8ed-bc189cc65628 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:00:09.145406 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-68ae0d8e-3108-4572-a8ed-bc189cc65628 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:00:09.665288 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-68ae0d8e-3108-4572-a8ed-bc189cc65628 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:00:09.680823 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-68ae0d8e-3108-4572-a8ed-bc189cc65628 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:00:09.687213 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-68ae0d8e-3108-4572-a8ed-bc189cc65628 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:00:09.689686 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-68ae0d8e-3108-4572-a8ed-bc189cc65628 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] 10.222.0.47 "GET /compute/v2.1/servers/798b77ff-c3ca-4c65-a120-db12ad953621" status: 200 len: 1278 microversion: 2.20 time: 0.600248 Feb 19 05:00:09.690619 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 24/55] 10.222.0.47 () {60 vars in 1267 bytes} [Fri Feb 19 05:00:09 2021] GET /compute/v2.1/servers/798b77ff-c3ca-4c65-a120-db12ad953621 => generated 1278 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 05:00:09.697303 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-be9b7d0b-476d-4ecf-a804-289eb1074601 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:00:09.698277 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-be9b7d0b-476d-4ecf-a804-289eb1074601 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] [instance: 9b43c13a-0c7e-45d7-96b0-83fe593a8b08] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:00:09.702124 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-e536720a-3e66-4892-8b16-4c1d01b28987 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24af0562e2aa43ca9d601be5e16fe9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ee9a43087d5497da3af9fbf68c4572d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:00:09.716340 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-e536720a-3e66-4892-8b16-4c1d01b28987 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] 10.222.0.47 "GET /compute/v2.1/servers/c74e760d-0b53-4508-ae21-494989132c3a" status: 200 len: 1225 microversion: 2.1 time: 0.710912 Feb 19 05:00:09.720045 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 32/56] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:00:08 2021] GET /compute/v2.1/servers/c74e760d-0b53-4508-ae21-494989132c3a => generated 1225 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:00:09.734920 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-be9b7d0b-476d-4ecf-a804-289eb1074601 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:00:09.735755 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-be9b7d0b-476d-4ecf-a804-289eb1074601 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:00:09.736852 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-be9b7d0b-476d-4ecf-a804-289eb1074601 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:00:09.737538 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-be9b7d0b-476d-4ecf-a804-289eb1074601 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:00:10.027193 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-44b3423c-316f-4619-b9de-c153e8a36681 tempest-DeleteServersTestJSON-1855409151 tempest-DeleteServersTestJSON-1855409151-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:00:10.032162 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-44b3423c-316f-4619-b9de-c153e8a36681 tempest-DeleteServersTestJSON-1855409151 tempest-DeleteServersTestJSON-1855409151-project] [instance: cb93b585-b24f-444e-851a-98f0f13de9b2] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:00:10.090141 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-44b3423c-316f-4619-b9de-c153e8a36681 tempest-DeleteServersTestJSON-1855409151 tempest-DeleteServersTestJSON-1855409151-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:00:10.093760 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-44b3423c-316f-4619-b9de-c153e8a36681 tempest-DeleteServersTestJSON-1855409151 tempest-DeleteServersTestJSON-1855409151-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:00:10.095311 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-44b3423c-316f-4619-b9de-c153e8a36681 tempest-DeleteServersTestJSON-1855409151 tempest-DeleteServersTestJSON-1855409151-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:00:10.096159 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-44b3423c-316f-4619-b9de-c153e8a36681 tempest-DeleteServersTestJSON-1855409151 tempest-DeleteServersTestJSON-1855409151-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:00:10.474181 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-be9b7d0b-476d-4ecf-a804-289eb1074601 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628d846121a14be78329ccc727c8869d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa473e12960449bbb0713a709e0abe4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:00:10.509618 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-be9b7d0b-476d-4ecf-a804-289eb1074601 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] 10.222.0.47 "GET /compute/v2.1/servers/9b43c13a-0c7e-45d7-96b0-83fe593a8b08" status: 200 len: 1317 microversion: 2.1 time: 0.817274 Feb 19 05:00:10.523876 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 25/57] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:00:09 2021] GET /compute/v2.1/servers/9b43c13a-0c7e-45d7-96b0-83fe593a8b08 => generated 1317 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:00:10.723016 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-3c536efe-cb54-46d9-a124-992004c7add8 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:00:10.724155 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-3c536efe-cb54-46d9-a124-992004c7add8 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] [instance: 798b77ff-c3ca-4c65-a120-db12ad953621] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:00:10.746596 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-3c536efe-cb54-46d9-a124-992004c7add8 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:00:10.749479 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-3c536efe-cb54-46d9-a124-992004c7add8 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:00:10.754023 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-3c536efe-cb54-46d9-a124-992004c7add8 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:00:10.756741 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-3c536efe-cb54-46d9-a124-992004c7add8 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:00:11.132772 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-3c536efe-cb54-46d9-a124-992004c7add8 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:00:11.159352 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-3c536efe-cb54-46d9-a124-992004c7add8 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:00:11.162871 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-3c536efe-cb54-46d9-a124-992004c7add8 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:00:11.164606 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-3c536efe-cb54-46d9-a124-992004c7add8 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] 10.222.0.47 "GET /compute/v2.1/servers/798b77ff-c3ca-4c65-a120-db12ad953621" status: 200 len: 1352 microversion: 2.20 time: 0.445867 Feb 19 05:00:11.169399 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 26/58] 10.222.0.47 () {60 vars in 1267 bytes} [Fri Feb 19 05:00:10 2021] GET /compute/v2.1/servers/798b77ff-c3ca-4c65-a120-db12ad953621 => generated 1352 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 05:00:11.185392 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-81fcb3c8-7b64-4409-873b-fb24c510853e tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:00:11.186649 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-81fcb3c8-7b64-4409-873b-fb24c510853e tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] [instance: c74e760d-0b53-4508-ae21-494989132c3a] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:00:11.203763 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-81fcb3c8-7b64-4409-873b-fb24c510853e tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:00:11.214546 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-81fcb3c8-7b64-4409-873b-fb24c510853e tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:00:11.216154 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-81fcb3c8-7b64-4409-873b-fb24c510853e tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:00:11.217068 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-81fcb3c8-7b64-4409-873b-fb24c510853e tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:00:12.110782 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-81fcb3c8-7b64-4409-873b-fb24c510853e tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24af0562e2aa43ca9d601be5e16fe9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ee9a43087d5497da3af9fbf68c4572d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:00:12.159141 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-81fcb3c8-7b64-4409-873b-fb24c510853e tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] 10.222.0.47 "GET /compute/v2.1/servers/c74e760d-0b53-4508-ae21-494989132c3a" status: 200 len: 1281 microversion: 2.1 time: 0.987698 Feb 19 05:00:12.170893 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 27/59] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:00:11 2021] GET /compute/v2.1/servers/c74e760d-0b53-4508-ae21-494989132c3a => generated 1281 bytes in 991 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:00:12.172546 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [req-16e28327-8218-4a00-b270-e8103b9efdcb req-65138901-1445-4b92-b413-e29d8ca268aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9b43c13a-0c7e-45d7-96b0-83fe593a8b08", "tag": "bf7bd73f-da1c-4506-980b-db75cc18c728"}]} {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:00:12.175197 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 05:00:12.175197 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: warnings.warn(msg) Feb 19 05:00:12.198575 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [req-16e28327-8218-4a00-b270-e8103b9efdcb req-65138901-1445-4b92-b413-e29d8ca268aa service nova] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:00:12.199031 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [req-16e28327-8218-4a00-b270-e8103b9efdcb req-65138901-1445-4b92-b413-e29d8ca268aa service nova] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:00:12.237500 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.compute.server_external_events [req-16e28327-8218-4a00-b270-e8103b9efdcb req-65138901-1445-4b92-b413-e29d8ca268aa service nova] Creating event network-changed:bf7bd73f-da1c-4506-980b-db75cc18c728 for instance 9b43c13a-0c7e-45d7-96b0-83fe593a8b08 on hv-cinder-77642 Feb 19 05:00:12.248751 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [req-16e28327-8218-4a00-b270-e8103b9efdcb req-65138901-1445-4b92-b413-e29d8ca268aa service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083545 Feb 19 05:00:12.250006 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 28/60] 10.222.0.47 () {64 vars in 1308 bytes} [Fri Feb 19 05:00:12 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 05:00:12.261325 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-727d1701-1599-401a-97e2-e35ddc4101e9 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:00:12.262631 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-727d1701-1599-401a-97e2-e35ddc4101e9 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] [instance: 9b43c13a-0c7e-45d7-96b0-83fe593a8b08] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:00:12.279526 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-727d1701-1599-401a-97e2-e35ddc4101e9 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:00:12.280466 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-727d1701-1599-401a-97e2-e35ddc4101e9 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:00:12.282145 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-727d1701-1599-401a-97e2-e35ddc4101e9 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:00:12.283755 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-727d1701-1599-401a-97e2-e35ddc4101e9 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:00:13.357471 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-44b3423c-316f-4619-b9de-c153e8a36681 tempest-DeleteServersTestJSON-1855409151 tempest-DeleteServersTestJSON-1855409151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbe79c8c7e046b28563ce75526c5554', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0703bf302bd646109e79f0f89f8938cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:00:13.376491 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-44b3423c-316f-4619-b9de-c153e8a36681 tempest-DeleteServersTestJSON-1855409151 tempest-DeleteServersTestJSON-1855409151-project] 10.222.0.47 "GET /compute/v2.1/servers/cb93b585-b24f-444e-851a-98f0f13de9b2" status: 200 len: 1315 microversion: 2.1 time: 3.358880 Feb 19 05:00:13.382035 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 33/61] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:00:10 2021] GET /compute/v2.1/servers/cb93b585-b24f-444e-851a-98f0f13de9b2 => generated 1315 bytes in 3374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:00:13.392613 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-49e22013-fcc8-4d52-807b-ffe3d0e1be34 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:00:13.393947 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-49e22013-fcc8-4d52-807b-ffe3d0e1be34 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] [instance: 798b77ff-c3ca-4c65-a120-db12ad953621] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:00:13.403161 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-49e22013-fcc8-4d52-807b-ffe3d0e1be34 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:00:13.403714 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-49e22013-fcc8-4d52-807b-ffe3d0e1be34 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:00:13.404607 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-49e22013-fcc8-4d52-807b-ffe3d0e1be34 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:00:13.405264 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-49e22013-fcc8-4d52-807b-ffe3d0e1be34 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:00:13.724809 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-49e22013-fcc8-4d52-807b-ffe3d0e1be34 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:00:13.795487 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-49e22013-fcc8-4d52-807b-ffe3d0e1be34 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:00:13.798349 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-49e22013-fcc8-4d52-807b-ffe3d0e1be34 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:00:13.800436 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-49e22013-fcc8-4d52-807b-ffe3d0e1be34 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] 10.222.0.47 "GET /compute/v2.1/servers/798b77ff-c3ca-4c65-a120-db12ad953621" status: 200 len: 1340 microversion: 2.20 time: 0.415295 Feb 19 05:00:13.801287 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 34/62] 10.222.0.47 () {60 vars in 1267 bytes} [Fri Feb 19 05:00:13 2021] GET /compute/v2.1/servers/798b77ff-c3ca-4c65-a120-db12ad953621 => generated 1340 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 05:00:13.809125 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-d5efcbcf-d241-46f9-8940-8a4f292a1d3e tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:00:13.810099 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-d5efcbcf-d241-46f9-8940-8a4f292a1d3e tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] [instance: c74e760d-0b53-4508-ae21-494989132c3a] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:00:13.822578 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-d5efcbcf-d241-46f9-8940-8a4f292a1d3e tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:00:13.823701 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-d5efcbcf-d241-46f9-8940-8a4f292a1d3e tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:00:13.825500 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-d5efcbcf-d241-46f9-8940-8a4f292a1d3e tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:00:13.826535 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-d5efcbcf-d241-46f9-8940-8a4f292a1d3e tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:00:14.149652 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-d5efcbcf-d241-46f9-8940-8a4f292a1d3e tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24af0562e2aa43ca9d601be5e16fe9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ee9a43087d5497da3af9fbf68c4572d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:00:14.164895 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-d5efcbcf-d241-46f9-8940-8a4f292a1d3e tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] 10.222.0.47 "GET /compute/v2.1/servers/c74e760d-0b53-4508-ae21-494989132c3a" status: 200 len: 1279 microversion: 2.1 time: 0.361179 Feb 19 05:00:14.166110 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 35/63] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:00:13 2021] GET /compute/v2.1/servers/c74e760d-0b53-4508-ae21-494989132c3a => generated 1279 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:00:14.180106 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-727d1701-1599-401a-97e2-e35ddc4101e9 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628d846121a14be78329ccc727c8869d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa473e12960449bbb0713a709e0abe4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:00:14.195174 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-727d1701-1599-401a-97e2-e35ddc4101e9 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] 10.222.0.47 "GET /compute/v2.1/servers/9b43c13a-0c7e-45d7-96b0-83fe593a8b08" status: 200 len: 1317 microversion: 2.1 time: 1.942549 Feb 19 05:00:14.196423 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 29/64] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:00:12 2021] GET /compute/v2.1/servers/9b43c13a-0c7e-45d7-96b0-83fe593a8b08 => generated 1317 bytes in 1946 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:00:14.410628 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-c7d99cc6-c591-495b-8ccc-0c2b3bbac911 tempest-DeleteServersTestJSON-1855409151 tempest-DeleteServersTestJSON-1855409151-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:00:14.414826 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-c7d99cc6-c591-495b-8ccc-0c2b3bbac911 tempest-DeleteServersTestJSON-1855409151 tempest-DeleteServersTestJSON-1855409151-project] [instance: cb93b585-b24f-444e-851a-98f0f13de9b2] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:00:14.470366 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-c7d99cc6-c591-495b-8ccc-0c2b3bbac911 tempest-DeleteServersTestJSON-1855409151 tempest-DeleteServersTestJSON-1855409151-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:00:14.471136 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-c7d99cc6-c591-495b-8ccc-0c2b3bbac911 tempest-DeleteServersTestJSON-1855409151 tempest-DeleteServersTestJSON-1855409151-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:00:14.472207 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-c7d99cc6-c591-495b-8ccc-0c2b3bbac911 tempest-DeleteServersTestJSON-1855409151 tempest-DeleteServersTestJSON-1855409151-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:00:14.472853 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-c7d99cc6-c591-495b-8ccc-0c2b3bbac911 tempest-DeleteServersTestJSON-1855409151 tempest-DeleteServersTestJSON-1855409151-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:00:14.823253 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-26f6096b-c850-470d-815f-efad297bd786 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:00:14.824406 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-26f6096b-c850-470d-815f-efad297bd786 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] [instance: 798b77ff-c3ca-4c65-a120-db12ad953621] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:00:14.834107 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-26f6096b-c850-470d-815f-efad297bd786 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:00:14.835496 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-26f6096b-c850-470d-815f-efad297bd786 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:00:14.836713 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-26f6096b-c850-470d-815f-efad297bd786 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:00:14.837438 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-26f6096b-c850-470d-815f-efad297bd786 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:00:15.090611 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-26f6096b-c850-470d-815f-efad297bd786 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:00:15.127824 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-26f6096b-c850-470d-815f-efad297bd786 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:00:15.129757 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-26f6096b-c850-470d-815f-efad297bd786 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:00:15.137504 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-26f6096b-c850-470d-815f-efad297bd786 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] 10.222.0.47 "GET /compute/v2.1/servers/798b77ff-c3ca-4c65-a120-db12ad953621" status: 200 len: 1340 microversion: 2.20 time: 0.319365 Feb 19 05:00:15.138536 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 30/65] 10.222.0.47 () {60 vars in 1267 bytes} [Fri Feb 19 05:00:14 2021] GET /compute/v2.1/servers/798b77ff-c3ca-4c65-a120-db12ad953621 => generated 1340 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 05:00:15.193162 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-06fc01cc-7740-4e18-b15b-d7b2c157e4dc tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:00:15.194031 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-06fc01cc-7740-4e18-b15b-d7b2c157e4dc tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] [instance: c74e760d-0b53-4508-ae21-494989132c3a] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:00:15.236689 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-06fc01cc-7740-4e18-b15b-d7b2c157e4dc tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:00:15.242380 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-06fc01cc-7740-4e18-b15b-d7b2c157e4dc tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:00:15.244228 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-06fc01cc-7740-4e18-b15b-d7b2c157e4dc tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:00:15.246398 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-06fc01cc-7740-4e18-b15b-d7b2c157e4dc tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:00:15.525588 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-06fc01cc-7740-4e18-b15b-d7b2c157e4dc tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24af0562e2aa43ca9d601be5e16fe9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ee9a43087d5497da3af9fbf68c4572d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:00:15.548409 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-06fc01cc-7740-4e18-b15b-d7b2c157e4dc tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] 10.222.0.47 "GET /compute/v2.1/servers/c74e760d-0b53-4508-ae21-494989132c3a" status: 200 len: 1279 microversion: 2.1 time: 0.359241 Feb 19 05:00:15.550855 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 31/66] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:00:15 2021] GET /compute/v2.1/servers/c74e760d-0b53-4508-ae21-494989132c3a => generated 1279 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:00:15.567113 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-dc3ac0b7-cdb6-45cf-b067-fbbe9631910a tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:00:15.568843 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-dc3ac0b7-cdb6-45cf-b067-fbbe9631910a tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] [instance: 9b43c13a-0c7e-45d7-96b0-83fe593a8b08] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:00:15.582535 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-dc3ac0b7-cdb6-45cf-b067-fbbe9631910a tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:00:15.585319 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-dc3ac0b7-cdb6-45cf-b067-fbbe9631910a tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:00:15.586562 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-dc3ac0b7-cdb6-45cf-b067-fbbe9631910a tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:00:15.588596 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-dc3ac0b7-cdb6-45cf-b067-fbbe9631910a tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:00:15.899289 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-c7d99cc6-c591-495b-8ccc-0c2b3bbac911 tempest-DeleteServersTestJSON-1855409151 tempest-DeleteServersTestJSON-1855409151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbe79c8c7e046b28563ce75526c5554', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0703bf302bd646109e79f0f89f8938cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:00:15.916131 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-c7d99cc6-c591-495b-8ccc-0c2b3bbac911 tempest-DeleteServersTestJSON-1855409151 tempest-DeleteServersTestJSON-1855409151-project] 10.222.0.47 "GET /compute/v2.1/servers/cb93b585-b24f-444e-851a-98f0f13de9b2" status: 200 len: 1315 microversion: 2.1 time: 1.520641 Feb 19 05:00:15.916840 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 36/67] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:00:14 2021] GET /compute/v2.1/servers/cb93b585-b24f-444e-851a-98f0f13de9b2 => generated 1315 bytes in 1523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:00:15.930135 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [req-6fa70057-5725-4553-b8d9-20e8804ee57f req-3c9b271b-ae20-43fd-a249-a67eae094dc3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "74c5a115-b174-49fe-9b75-574e484a09e2", "tag": "8f7e187d-255a-42f5-82f0-109c4fec5aaa"}]} {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:00:15.941343 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 05:00:15.941343 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: warnings.warn(msg) Feb 19 05:00:15.965528 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [req-6fa70057-5725-4553-b8d9-20e8804ee57f req-3c9b271b-ae20-43fd-a249-a67eae094dc3 service nova] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:00:15.966054 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [req-6fa70057-5725-4553-b8d9-20e8804ee57f req-3c9b271b-ae20-43fd-a249-a67eae094dc3 service nova] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:00:15.992177 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.compute.server_external_events [req-6fa70057-5725-4553-b8d9-20e8804ee57f req-3c9b271b-ae20-43fd-a249-a67eae094dc3 service nova] Creating event network-changed:8f7e187d-255a-42f5-82f0-109c4fec5aaa for instance 74c5a115-b174-49fe-9b75-574e484a09e2 on hv-cinder-77642 Feb 19 05:00:15.993029 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [req-6fa70057-5725-4553-b8d9-20e8804ee57f req-3c9b271b-ae20-43fd-a249-a67eae094dc3 service nova] Acquired lock "compute-rpcapi-router" {{(pid=98154) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:266}} Feb 19 05:00:15.994663 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-62ef04e9-7863-40c1-abdb-0caaf5ebb72b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:00:15.995363 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-62ef04e9-7863-40c1-abdb-0caaf5ebb72b None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:00:15.996481 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-62ef04e9-7863-40c1-abdb-0caaf5ebb72b None None] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:00:15.997337 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-62ef04e9-7863-40c1-abdb-0caaf5ebb72b None None] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:00:16.010098 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.compute.rpcapi [None req-62ef04e9-7863-40c1-abdb-0caaf5ebb72b None None] Automatically selected compute RPC version 5.13 from minimum service version 54 Feb 19 05:00:16.011417 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-62ef04e9-7863-40c1-abdb-0caaf5ebb72b None None] Releasing lock "compute-rpcapi-router" {{(pid=98154) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:282}} Feb 19 05:00:16.063554 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-62ef04e9-7863-40c1-abdb-0caaf5ebb72b None None] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.145256 Feb 19 05:00:16.064542 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 37/68] 10.222.0.47 () {64 vars in 1308 bytes} [Fri Feb 19 05:00:15 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 05:00:16.184027 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [req-183f8795-7478-40c1-a930-ce09d3c71af0 req-ddd8c798-726a-474a-aace-bc39bf29299c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb93b585-b24f-444e-851a-98f0f13de9b2", "name": "network-vif-plugged", "status": "completed", "tag": "42106eef-d038-443f-9ab2-92e08bef76ec"}]} {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:00:16.186203 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 05:00:16.186203 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: warnings.warn(msg) Feb 19 05:00:16.212446 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [req-183f8795-7478-40c1-a930-ce09d3c71af0 req-ddd8c798-726a-474a-aace-bc39bf29299c service nova] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:00:16.212985 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [req-183f8795-7478-40c1-a930-ce09d3c71af0 req-ddd8c798-726a-474a-aace-bc39bf29299c service nova] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:00:16.263799 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.compute.server_external_events [req-183f8795-7478-40c1-a930-ce09d3c71af0 req-ddd8c798-726a-474a-aace-bc39bf29299c service nova] Creating event network-vif-plugged:42106eef-d038-443f-9ab2-92e08bef76ec for instance cb93b585-b24f-444e-851a-98f0f13de9b2 on hv-cinder-77642 Feb 19 05:00:16.273536 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [req-183f8795-7478-40c1-a930-ce09d3c71af0 req-ddd8c798-726a-474a-aace-bc39bf29299c service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.204925 Feb 19 05:00:16.279093 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 38/69] 10.222.0.47 () {64 vars in 1308 bytes} [Fri Feb 19 05:00:16 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 05:00:16.293707 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-dae363e6-cb55-4863-91f5-92960fc0e0c9 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:00:16.293707 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-dae363e6-cb55-4863-91f5-92960fc0e0c9 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] [instance: 798b77ff-c3ca-4c65-a120-db12ad953621] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:00:16.310854 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-dae363e6-cb55-4863-91f5-92960fc0e0c9 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:00:16.311406 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-dae363e6-cb55-4863-91f5-92960fc0e0c9 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:00:16.312312 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-dae363e6-cb55-4863-91f5-92960fc0e0c9 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:00:16.313429 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-dae363e6-cb55-4863-91f5-92960fc0e0c9 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:00:16.334013 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-dc3ac0b7-cdb6-45cf-b067-fbbe9631910a tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628d846121a14be78329ccc727c8869d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa473e12960449bbb0713a709e0abe4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:00:16.354535 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-dc3ac0b7-cdb6-45cf-b067-fbbe9631910a tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] 10.222.0.47 "GET /compute/v2.1/servers/9b43c13a-0c7e-45d7-96b0-83fe593a8b08" status: 200 len: 1317 microversion: 2.1 time: 0.802190 Feb 19 05:00:16.355540 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 32/70] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:00:15 2021] GET /compute/v2.1/servers/9b43c13a-0c7e-45d7-96b0-83fe593a8b08 => generated 1317 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:00:16.568766 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-26019ac0-c4a8-4af0-a5c1-6f79db5f914c tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:00:16.570082 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-26019ac0-c4a8-4af0-a5c1-6f79db5f914c tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] [instance: c74e760d-0b53-4508-ae21-494989132c3a] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:00:16.591035 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-26019ac0-c4a8-4af0-a5c1-6f79db5f914c tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:00:16.591807 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-26019ac0-c4a8-4af0-a5c1-6f79db5f914c tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:00:16.593030 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-26019ac0-c4a8-4af0-a5c1-6f79db5f914c tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:00:16.593719 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-26019ac0-c4a8-4af0-a5c1-6f79db5f914c tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:00:17.377830 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-26019ac0-c4a8-4af0-a5c1-6f79db5f914c tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24af0562e2aa43ca9d601be5e16fe9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ee9a43087d5497da3af9fbf68c4572d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:00:17.394056 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-26019ac0-c4a8-4af0-a5c1-6f79db5f914c tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] 10.222.0.47 "GET /compute/v2.1/servers/c74e760d-0b53-4508-ae21-494989132c3a" status: 200 len: 1279 microversion: 2.1 time: 0.829426 Feb 19 05:00:17.398489 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 33/71] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:00:16 2021] GET /compute/v2.1/servers/c74e760d-0b53-4508-ae21-494989132c3a => generated 1279 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 05:00:17.414429 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-1caaa7d0-e580-47fa-9245-076cce4a266a tempest-DeleteServersTestJSON-1855409151 tempest-DeleteServersTestJSON-1855409151-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:00:17.415379 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-1caaa7d0-e580-47fa-9245-076cce4a266a tempest-DeleteServersTestJSON-1855409151 tempest-DeleteServersTestJSON-1855409151-project] [instance: cb93b585-b24f-444e-851a-98f0f13de9b2] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:00:17.436676 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-1caaa7d0-e580-47fa-9245-076cce4a266a tempest-DeleteServersTestJSON-1855409151 tempest-DeleteServersTestJSON-1855409151-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:00:17.439546 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-1caaa7d0-e580-47fa-9245-076cce4a266a tempest-DeleteServersTestJSON-1855409151 tempest-DeleteServersTestJSON-1855409151-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:00:17.440703 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-1caaa7d0-e580-47fa-9245-076cce4a266a tempest-DeleteServersTestJSON-1855409151 tempest-DeleteServersTestJSON-1855409151-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:00:17.441301 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-1caaa7d0-e580-47fa-9245-076cce4a266a tempest-DeleteServersTestJSON-1855409151 tempest-DeleteServersTestJSON-1855409151-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:00:17.843531 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-dae363e6-cb55-4863-91f5-92960fc0e0c9 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:00:17.864649 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-dae363e6-cb55-4863-91f5-92960fc0e0c9 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:00:17.878675 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-dae363e6-cb55-4863-91f5-92960fc0e0c9 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:00:17.883871 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-dae363e6-cb55-4863-91f5-92960fc0e0c9 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] 10.222.0.47 "GET /compute/v2.1/servers/798b77ff-c3ca-4c65-a120-db12ad953621" status: 200 len: 1408 microversion: 2.20 time: 1.600697 Feb 19 05:00:17.885894 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 39/72] 10.222.0.47 () {60 vars in 1267 bytes} [Fri Feb 19 05:00:16 2021] GET /compute/v2.1/servers/798b77ff-c3ca-4c65-a120-db12ad953621 => generated 1408 bytes in 1606 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 05:00:17.903847 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-11274e7b-0c53-4e41-8744-bdd7f470d986 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:00:17.905407 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-11274e7b-0c53-4e41-8744-bdd7f470d986 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] [instance: 9b43c13a-0c7e-45d7-96b0-83fe593a8b08] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:00:17.925208 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-11274e7b-0c53-4e41-8744-bdd7f470d986 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:00:17.939951 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-11274e7b-0c53-4e41-8744-bdd7f470d986 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:00:17.952626 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-11274e7b-0c53-4e41-8744-bdd7f470d986 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:00:17.953593 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-11274e7b-0c53-4e41-8744-bdd7f470d986 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:00:18.860459 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-1caaa7d0-e580-47fa-9245-076cce4a266a tempest-DeleteServersTestJSON-1855409151 tempest-DeleteServersTestJSON-1855409151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbe79c8c7e046b28563ce75526c5554', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0703bf302bd646109e79f0f89f8938cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:00:18.912405 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-1caaa7d0-e580-47fa-9245-076cce4a266a tempest-DeleteServersTestJSON-1855409151 tempest-DeleteServersTestJSON-1855409151-project] 10.222.0.47 "GET /compute/v2.1/servers/cb93b585-b24f-444e-851a-98f0f13de9b2" status: 200 len: 1315 microversion: 2.1 time: 1.511589 Feb 19 05:00:18.936954 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 34/73] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:00:17 2021] GET /compute/v2.1/servers/cb93b585-b24f-444e-851a-98f0f13de9b2 => generated 1315 bytes in 1538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:00:18.958398 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [req-23a934ee-66f4-4325-8a10-d4596955c4cb req-bf1246f8-ce2d-4246-af07-e80b67bdaa69 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b43c13a-0c7e-45d7-96b0-83fe593a8b08", "name": "network-vif-plugged", "status": "completed", "tag": "bf7bd73f-da1c-4506-980b-db75cc18c728"}]} {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:00:18.962749 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 05:00:18.962749 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: warnings.warn(msg) Feb 19 05:00:18.980865 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [req-23a934ee-66f4-4325-8a10-d4596955c4cb req-bf1246f8-ce2d-4246-af07-e80b67bdaa69 service nova] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:00:18.981395 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [req-23a934ee-66f4-4325-8a10-d4596955c4cb req-bf1246f8-ce2d-4246-af07-e80b67bdaa69 service nova] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:00:19.046934 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.compute.server_external_events [req-23a934ee-66f4-4325-8a10-d4596955c4cb req-bf1246f8-ce2d-4246-af07-e80b67bdaa69 service nova] Creating event network-vif-plugged:bf7bd73f-da1c-4506-980b-db75cc18c728 for instance 9b43c13a-0c7e-45d7-96b0-83fe593a8b08 on hv-cinder-77642 Feb 19 05:00:19.067074 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [req-23a934ee-66f4-4325-8a10-d4596955c4cb req-bf1246f8-ce2d-4246-af07-e80b67bdaa69 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118105 Feb 19 05:00:19.068460 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 35/74] 10.222.0.47 () {64 vars in 1308 bytes} [Fri Feb 19 05:00:18 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 05:00:19.087377 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-520d0b54-8aad-4c85-be0c-e716e7a1d199 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:00:19.089260 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-520d0b54-8aad-4c85-be0c-e716e7a1d199 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] [instance: c74e760d-0b53-4508-ae21-494989132c3a] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:00:19.121184 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-520d0b54-8aad-4c85-be0c-e716e7a1d199 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:00:19.122064 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-520d0b54-8aad-4c85-be0c-e716e7a1d199 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:00:19.123877 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-520d0b54-8aad-4c85-be0c-e716e7a1d199 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:00:19.124754 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-520d0b54-8aad-4c85-be0c-e716e7a1d199 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:00:19.302284 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-11274e7b-0c53-4e41-8744-bdd7f470d986 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628d846121a14be78329ccc727c8869d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa473e12960449bbb0713a709e0abe4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:00:19.329533 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-11274e7b-0c53-4e41-8744-bdd7f470d986 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] 10.222.0.47 "GET /compute/v2.1/servers/9b43c13a-0c7e-45d7-96b0-83fe593a8b08" status: 200 len: 1317 microversion: 2.1 time: 1.441346 Feb 19 05:00:19.332147 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 40/75] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:00:17 2021] GET /compute/v2.1/servers/9b43c13a-0c7e-45d7-96b0-83fe593a8b08 => generated 1317 bytes in 1445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:00:19.352455 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-534431b2-eae6-4d61-8be7-f0b0e6ddeb1e tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:00:19.354155 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-534431b2-eae6-4d61-8be7-f0b0e6ddeb1e tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] [instance: 798b77ff-c3ca-4c65-a120-db12ad953621] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:00:19.374640 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-534431b2-eae6-4d61-8be7-f0b0e6ddeb1e tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:00:19.375129 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-534431b2-eae6-4d61-8be7-f0b0e6ddeb1e tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:00:19.380540 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-534431b2-eae6-4d61-8be7-f0b0e6ddeb1e tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:00:19.381694 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-534431b2-eae6-4d61-8be7-f0b0e6ddeb1e tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:00:21.107284 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-534431b2-eae6-4d61-8be7-f0b0e6ddeb1e tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:00:21.125624 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-520d0b54-8aad-4c85-be0c-e716e7a1d199 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24af0562e2aa43ca9d601be5e16fe9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ee9a43087d5497da3af9fbf68c4572d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:00:21.128140 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-534431b2-eae6-4d61-8be7-f0b0e6ddeb1e tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:00:21.138377 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-520d0b54-8aad-4c85-be0c-e716e7a1d199 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] 10.222.0.47 "GET /compute/v2.1/servers/c74e760d-0b53-4508-ae21-494989132c3a" status: 200 len: 1321 microversion: 2.1 time: 2.063711 Feb 19 05:00:21.144170 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 36/76] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:00:19 2021] GET /compute/v2.1/servers/c74e760d-0b53-4508-ae21-494989132c3a => generated 1321 bytes in 2073 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:00:21.150168 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-bc697c1d-b441-4b61-a80c-a37e3133e0ee tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-679389512", "imageRef": "53cdf9de-e495-4ca8-845f-6be2bf32cecb", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f5994d75-3690-4c0d-a23c-9728f5c2f0cf"}], "security_groups": [{"name": "tempest-securitygroup--832925244"}], "key_name": "tempest-keypair-61000085", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:00:21.162238 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-534431b2-eae6-4d61-8be7-f0b0e6ddeb1e tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:00:21.171922 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-534431b2-eae6-4d61-8be7-f0b0e6ddeb1e tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] 10.222.0.47 "GET /compute/v2.1/servers/798b77ff-c3ca-4c65-a120-db12ad953621" status: 200 len: 1408 microversion: 2.20 time: 1.833946 Feb 19 05:00:21.173396 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 41/77] 10.222.0.47 () {60 vars in 1267 bytes} [Fri Feb 19 05:00:19 2021] GET /compute/v2.1/servers/798b77ff-c3ca-4c65-a120-db12ad953621 => generated 1408 bytes in 1840 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 05:00:21.182681 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-7085a470-5561-4877-b52d-9869ca01ff04 tempest-DeleteServersTestJSON-1855409151 tempest-DeleteServersTestJSON-1855409151-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:00:21.183371 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-7085a470-5561-4877-b52d-9869ca01ff04 tempest-DeleteServersTestJSON-1855409151 tempest-DeleteServersTestJSON-1855409151-project] [instance: cb93b585-b24f-444e-851a-98f0f13de9b2] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:00:21.211220 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-7085a470-5561-4877-b52d-9869ca01ff04 tempest-DeleteServersTestJSON-1855409151 tempest-DeleteServersTestJSON-1855409151-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:00:21.211735 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-7085a470-5561-4877-b52d-9869ca01ff04 tempest-DeleteServersTestJSON-1855409151 tempest-DeleteServersTestJSON-1855409151-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:00:21.221622 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-7085a470-5561-4877-b52d-9869ca01ff04 tempest-DeleteServersTestJSON-1855409151 tempest-DeleteServersTestJSON-1855409151-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:00:21.222747 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-7085a470-5561-4877-b52d-9869ca01ff04 tempest-DeleteServersTestJSON-1855409151 tempest-DeleteServersTestJSON-1855409151-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:00:21.650157 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.network.neutron [None req-bc697c1d-b441-4b61-a80c-a37e3133e0ee tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] validate_networks() for [('f5994d75-3690-4c0d-a23c-9728f5c2f0cf', None, None, None)] {{(pid=98153) validate_networks /opt/stack/nova/nova/network/neutron.py:2345}} Feb 19 05:00:22.308260 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-7085a470-5561-4877-b52d-9869ca01ff04 tempest-DeleteServersTestJSON-1855409151 tempest-DeleteServersTestJSON-1855409151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbe79c8c7e046b28563ce75526c5554', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0703bf302bd646109e79f0f89f8938cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:00:22.336512 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-7085a470-5561-4877-b52d-9869ca01ff04 tempest-DeleteServersTestJSON-1855409151 tempest-DeleteServersTestJSON-1855409151-project] 10.222.0.47 "GET /compute/v2.1/servers/cb93b585-b24f-444e-851a-98f0f13de9b2" status: 200 len: 1315 microversion: 2.1 time: 1.157562 Feb 19 05:00:22.338522 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 42/78] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:00:21 2021] GET /compute/v2.1/servers/cb93b585-b24f-444e-851a-98f0f13de9b2 => generated 1315 bytes in 1164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:00:22.361376 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-f21130f4-ebe6-4ff5-9389-fa29e8977b3e tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:00:22.361919 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-f21130f4-ebe6-4ff5-9389-fa29e8977b3e tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] [instance: 9b43c13a-0c7e-45d7-96b0-83fe593a8b08] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:00:22.393664 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-f21130f4-ebe6-4ff5-9389-fa29e8977b3e tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:00:22.394168 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-f21130f4-ebe6-4ff5-9389-fa29e8977b3e tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:00:22.395208 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-f21130f4-ebe6-4ff5-9389-fa29e8977b3e tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:00:22.395806 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-f21130f4-ebe6-4ff5-9389-fa29e8977b3e tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:00:24.085888 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-f21130f4-ebe6-4ff5-9389-fa29e8977b3e tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628d846121a14be78329ccc727c8869d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa473e12960449bbb0713a709e0abe4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:00:24.117407 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-f21130f4-ebe6-4ff5-9389-fa29e8977b3e tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] 10.222.0.47 "GET /compute/v2.1/servers/9b43c13a-0c7e-45d7-96b0-83fe593a8b08" status: 200 len: 1507 microversion: 2.1 time: 1.766124 Feb 19 05:00:24.118263 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 43/79] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:00:22 2021] GET /compute/v2.1/servers/9b43c13a-0c7e-45d7-96b0-83fe593a8b08 => generated 1507 bytes in 1779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:00:24.123231 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [req-9dfba176-eb79-4a00-8787-00a5d74b44ce req-2ce9aa55-0624-4351-9459-ca6b26a04454 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74c5a115-b174-49fe-9b75-574e484a09e2", "name": "network-vif-plugged", "status": "completed", "tag": "8f7e187d-255a-42f5-82f0-109c4fec5aaa"}]} {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:00:24.125447 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 05:00:24.125447 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: warnings.warn(msg) Feb 19 05:00:24.143537 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [req-9dfba176-eb79-4a00-8787-00a5d74b44ce req-2ce9aa55-0624-4351-9459-ca6b26a04454 service nova] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:00:24.144053 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [req-9dfba176-eb79-4a00-8787-00a5d74b44ce req-2ce9aa55-0624-4351-9459-ca6b26a04454 service nova] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:00:24.175593 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.compute.server_external_events [req-9dfba176-eb79-4a00-8787-00a5d74b44ce req-2ce9aa55-0624-4351-9459-ca6b26a04454 service nova] Creating event network-vif-plugged:8f7e187d-255a-42f5-82f0-109c4fec5aaa for instance 74c5a115-b174-49fe-9b75-574e484a09e2 on hv-cinder-77642 Feb 19 05:00:24.181787 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [req-9dfba176-eb79-4a00-8787-00a5d74b44ce req-2ce9aa55-0624-4351-9459-ca6b26a04454 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062403 Feb 19 05:00:24.182935 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 44/80] 10.222.0.47 () {64 vars in 1308 bytes} [Fri Feb 19 05:00:24 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 05:00:24.190497 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-e2a369dc-ca69-4e35-b865-b717ca983309 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:00:24.191519 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-e2a369dc-ca69-4e35-b865-b717ca983309 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] [instance: c74e760d-0b53-4508-ae21-494989132c3a] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:00:24.201231 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-e2a369dc-ca69-4e35-b865-b717ca983309 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:00:24.202007 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-e2a369dc-ca69-4e35-b865-b717ca983309 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:00:24.203517 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-e2a369dc-ca69-4e35-b865-b717ca983309 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:00:24.204192 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-e2a369dc-ca69-4e35-b865-b717ca983309 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:00:25.722599 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.virt.hardware [None req-bc697c1d-b441-4b61-a80c-a37e3133e0ee tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Flavor limits 0:0:0 {{(pid=98153) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 19 05:00:25.725835 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.virt.hardware [None req-bc697c1d-b441-4b61-a80c-a37e3133e0ee tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Image limits 0:0:0 {{(pid=98153) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Feb 19 05:00:25.726685 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.virt.hardware [None req-bc697c1d-b441-4b61-a80c-a37e3133e0ee tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Flavor pref 0:0:0 {{(pid=98153) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 19 05:00:25.727432 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.virt.hardware [None req-bc697c1d-b441-4b61-a80c-a37e3133e0ee tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Image pref 0:0:0 {{(pid=98153) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Feb 19 05:00:25.728190 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.virt.hardware [None req-bc697c1d-b441-4b61-a80c-a37e3133e0ee tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98153) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Feb 19 05:00:25.762620 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-bc697c1d-b441-4b61-a80c-a37e3133e0ee tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:00:25.765490 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-bc697c1d-b441-4b61-a80c-a37e3133e0ee tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:00:25.767226 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-bc697c1d-b441-4b61-a80c-a37e3133e0ee tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:00:25.768087 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-bc697c1d-b441-4b61-a80c-a37e3133e0ee tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:00:25.801767 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.quota [None req-bc697c1d-b441-4b61-a80c-a37e3133e0ee tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Getting quotas for project e50941a0cab243e9a320ff22a7648de6. Resources: {'instances', 'ram', 'cores'} {{(pid=98153) _get_quotas /opt/stack/nova/nova/quota.py:388}} Feb 19 05:00:25.810889 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.quota [None req-bc697c1d-b441-4b61-a80c-a37e3133e0ee tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Getting quotas for user 7a3274478c0a421895f43618dc827ea9 and project e50941a0cab243e9a320ff22a7648de6. Resources: {'instances', 'ram', 'cores'} {{(pid=98153) _get_quotas /opt/stack/nova/nova/quota.py:380}} Feb 19 05:00:25.834207 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-bc697c1d-b441-4b61-a80c-a37e3133e0ee tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Going to run 1 instances... {{(pid=98153) _provision_instances /opt/stack/nova/nova/compute/api.py:1264}} Feb 19 05:00:25.842113 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-bc697c1d-b441-4b61-a80c-a37e3133e0ee tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] [instance: be65ea57-bc8d-4bce-80c3-33d8b6007ed1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='53cdf9de-e495-4ca8-845f-6be2bf32cecb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98153) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1666}} Feb 19 05:00:26.202710 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-bc697c1d-b441-4b61-a80c-a37e3133e0ee tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 5.056621 Feb 19 05:00:26.219481 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 37/81] 10.222.0.47 () {60 vars in 1137 bytes} [Fri Feb 19 05:00:21 2021] POST /compute/v2.1/servers => generated 401 bytes in 5067 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 19 05:00:26.253215 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-4315e100-cad4-40d5-a1ea-4198d2dceb52 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:00:26.254487 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-4315e100-cad4-40d5-a1ea-4198d2dceb52 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] [instance: 798b77ff-c3ca-4c65-a120-db12ad953621] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:00:26.311975 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-4315e100-cad4-40d5-a1ea-4198d2dceb52 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:00:26.313072 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-4315e100-cad4-40d5-a1ea-4198d2dceb52 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:00:26.318868 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-4315e100-cad4-40d5-a1ea-4198d2dceb52 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:00:26.336687 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-4315e100-cad4-40d5-a1ea-4198d2dceb52 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:00:26.704708 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-e2a369dc-ca69-4e35-b865-b717ca983309 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24af0562e2aa43ca9d601be5e16fe9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ee9a43087d5497da3af9fbf68c4572d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:00:26.746976 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-e2a369dc-ca69-4e35-b865-b717ca983309 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] 10.222.0.47 "GET /compute/v2.1/servers/c74e760d-0b53-4508-ae21-494989132c3a" status: 200 len: 1321 microversion: 2.1 time: 2.561908 Feb 19 05:00:26.748951 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 45/82] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:00:24 2021] GET /compute/v2.1/servers/c74e760d-0b53-4508-ae21-494989132c3a => generated 1321 bytes in 2565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:00:26.761627 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-a05feaf3-762d-469e-8ce4-89af7e2ab0c1 tempest-DeleteServersTestJSON-1855409151 tempest-DeleteServersTestJSON-1855409151-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:00:26.763383 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-a05feaf3-762d-469e-8ce4-89af7e2ab0c1 tempest-DeleteServersTestJSON-1855409151 tempest-DeleteServersTestJSON-1855409151-project] [instance: cb93b585-b24f-444e-851a-98f0f13de9b2] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:00:26.782228 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-a05feaf3-762d-469e-8ce4-89af7e2ab0c1 tempest-DeleteServersTestJSON-1855409151 tempest-DeleteServersTestJSON-1855409151-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:00:26.788442 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-a05feaf3-762d-469e-8ce4-89af7e2ab0c1 tempest-DeleteServersTestJSON-1855409151 tempest-DeleteServersTestJSON-1855409151-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:00:26.791216 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-a05feaf3-762d-469e-8ce4-89af7e2ab0c1 tempest-DeleteServersTestJSON-1855409151 tempest-DeleteServersTestJSON-1855409151-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:00:26.793209 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-a05feaf3-762d-469e-8ce4-89af7e2ab0c1 tempest-DeleteServersTestJSON-1855409151 tempest-DeleteServersTestJSON-1855409151-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:00:27.305218 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-4315e100-cad4-40d5-a1ea-4198d2dceb52 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:00:27.322701 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-4315e100-cad4-40d5-a1ea-4198d2dceb52 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:00:27.330936 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-4315e100-cad4-40d5-a1ea-4198d2dceb52 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:00:27.335453 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-4315e100-cad4-40d5-a1ea-4198d2dceb52 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] 10.222.0.47 "GET /compute/v2.1/servers/798b77ff-c3ca-4c65-a120-db12ad953621" status: 200 len: 1408 microversion: 2.20 time: 1.114230 Feb 19 05:00:27.349571 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 38/83] 10.222.0.47 () {60 vars in 1267 bytes} [Fri Feb 19 05:00:26 2021] GET /compute/v2.1/servers/798b77ff-c3ca-4c65-a120-db12ad953621 => generated 1408 bytes in 1129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 05:00:27.356063 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-3dac3c9f-934f-4e84-af06-ecc70e1de60a tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:00:27.357041 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-3dac3c9f-934f-4e84-af06-ecc70e1de60a tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] [instance: be65ea57-bc8d-4bce-80c3-33d8b6007ed1] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:00:27.588050 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-3dac3c9f-934f-4e84-af06-ecc70e1de60a tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3274478c0a421895f43618dc827ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50941a0cab243e9a320ff22a7648de6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:00:27.601693 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-3dac3c9f-934f-4e84-af06-ecc70e1de60a tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] 10.222.0.47 "GET /compute/v2.1/servers/be65ea57-bc8d-4bce-80c3-33d8b6007ed1" status: 200 len: 1235 microversion: 2.1 time: 0.248874 Feb 19 05:00:27.602409 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 39/84] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:00:27 2021] GET /compute/v2.1/servers/be65ea57-bc8d-4bce-80c3-33d8b6007ed1 => generated 1235 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:00:28.107976 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [req-dced1b85-b350-4fd2-b7e0-effcb1c3bc63 req-a2a2740d-c6d8-4aa1-b23e-6846a359503c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "798b77ff-c3ca-4c65-a120-db12ad953621", "tag": "6af5e97b-75ed-4d80-88eb-6ea5c37a0234"}]} {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:00:28.111399 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 05:00:28.111399 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: warnings.warn(msg) Feb 19 05:00:28.123831 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [req-dced1b85-b350-4fd2-b7e0-effcb1c3bc63 req-a2a2740d-c6d8-4aa1-b23e-6846a359503c service nova] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:00:28.124701 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [req-dced1b85-b350-4fd2-b7e0-effcb1c3bc63 req-a2a2740d-c6d8-4aa1-b23e-6846a359503c service nova] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:00:28.144271 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.compute.server_external_events [req-dced1b85-b350-4fd2-b7e0-effcb1c3bc63 req-a2a2740d-c6d8-4aa1-b23e-6846a359503c service nova] Creating event network-changed:6af5e97b-75ed-4d80-88eb-6ea5c37a0234 for instance 798b77ff-c3ca-4c65-a120-db12ad953621 on hv-cinder-77642 Feb 19 05:00:28.150378 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [req-dced1b85-b350-4fd2-b7e0-effcb1c3bc63 req-a2a2740d-c6d8-4aa1-b23e-6846a359503c service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.543757 Feb 19 05:00:28.152649 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 40/85] 10.222.0.47 () {64 vars in 1308 bytes} [Fri Feb 19 05:00:27 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 05:00:28.160278 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-f7288db5-2373-4526-982b-1a3a27c7652e tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a406f7aa-c912-4fa8-a690-6741832a6689"}} {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:00:28.162901 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-f7288db5-2373-4526-982b-1a3a27c7652e tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] [instance: 9b43c13a-0c7e-45d7-96b0-83fe593a8b08] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:00:28.173004 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-f7288db5-2373-4526-982b-1a3a27c7652e tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:00:28.174038 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-f7288db5-2373-4526-982b-1a3a27c7652e tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:00:28.175320 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-f7288db5-2373-4526-982b-1a3a27c7652e tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:00:28.176043 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-f7288db5-2373-4526-982b-1a3a27c7652e tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:00:28.245377 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-a05feaf3-762d-469e-8ce4-89af7e2ab0c1 tempest-DeleteServersTestJSON-1855409151 tempest-DeleteServersTestJSON-1855409151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbe79c8c7e046b28563ce75526c5554', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0703bf302bd646109e79f0f89f8938cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:00:28.257834 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-a05feaf3-762d-469e-8ce4-89af7e2ab0c1 tempest-DeleteServersTestJSON-1855409151 tempest-DeleteServersTestJSON-1855409151-project] 10.222.0.47 "GET /compute/v2.1/servers/cb93b585-b24f-444e-851a-98f0f13de9b2" status: 200 len: 1502 microversion: 2.1 time: 1.506949 Feb 19 05:00:28.258832 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 46/86] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:00:26 2021] GET /compute/v2.1/servers/cb93b585-b24f-444e-851a-98f0f13de9b2 => generated 1502 bytes in 1509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:00:28.277787 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-40be645f-85c5-4659-b995-fdb75c8c82a2 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:00:28.278711 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-40be645f-85c5-4659-b995-fdb75c8c82a2 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] [instance: c74e760d-0b53-4508-ae21-494989132c3a] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:00:28.290716 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-40be645f-85c5-4659-b995-fdb75c8c82a2 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:00:28.291550 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-40be645f-85c5-4659-b995-fdb75c8c82a2 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:00:28.292621 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-40be645f-85c5-4659-b995-fdb75c8c82a2 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:00:28.293285 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-40be645f-85c5-4659-b995-fdb75c8c82a2 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:00:29.128458 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-40be645f-85c5-4659-b995-fdb75c8c82a2 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24af0562e2aa43ca9d601be5e16fe9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ee9a43087d5497da3af9fbf68c4572d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:00:29.141807 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-40be645f-85c5-4659-b995-fdb75c8c82a2 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] 10.222.0.47 "GET /compute/v2.1/servers/c74e760d-0b53-4508-ae21-494989132c3a" status: 200 len: 1321 microversion: 2.1 time: 0.868665 Feb 19 05:00:29.148789 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 47/87] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:00:28 2021] GET /compute/v2.1/servers/c74e760d-0b53-4508-ae21-494989132c3a => generated 1321 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:00:29.163273 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-7ba3c241-d484-4734-bdc6-3c6fb30640e2 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:00:29.164767 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-7ba3c241-d484-4734-bdc6-3c6fb30640e2 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] [instance: 798b77ff-c3ca-4c65-a120-db12ad953621] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:00:29.181431 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-7ba3c241-d484-4734-bdc6-3c6fb30640e2 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:00:29.181946 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-7ba3c241-d484-4734-bdc6-3c6fb30640e2 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:00:29.182864 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-7ba3c241-d484-4734-bdc6-3c6fb30640e2 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:00:29.183538 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-7ba3c241-d484-4734-bdc6-3c6fb30640e2 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:00:30.131883 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-7ba3c241-d484-4734-bdc6-3c6fb30640e2 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:00:30.147374 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-7ba3c241-d484-4734-bdc6-3c6fb30640e2 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:00:30.149206 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-7ba3c241-d484-4734-bdc6-3c6fb30640e2 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:00:30.150446 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-7ba3c241-d484-4734-bdc6-3c6fb30640e2 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] 10.222.0.47 "GET /compute/v2.1/servers/798b77ff-c3ca-4c65-a120-db12ad953621" status: 200 len: 1408 microversion: 2.20 time: 1.000409 Feb 19 05:00:30.151082 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 48/88] 10.222.0.47 () {60 vars in 1267 bytes} [Fri Feb 19 05:00:29 2021] GET /compute/v2.1/servers/798b77ff-c3ca-4c65-a120-db12ad953621 => generated 1408 bytes in 1002 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 05:00:30.175869 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-41a7316b-86e1-4891-9b4b-6c5f3aa6f020 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:00:30.176557 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-41a7316b-86e1-4891-9b4b-6c5f3aa6f020 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] [instance: be65ea57-bc8d-4bce-80c3-33d8b6007ed1] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:00:30.200165 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-41a7316b-86e1-4891-9b4b-6c5f3aa6f020 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:00:30.200688 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-41a7316b-86e1-4891-9b4b-6c5f3aa6f020 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:00:30.201682 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-41a7316b-86e1-4891-9b4b-6c5f3aa6f020 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:00:30.202115 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-41a7316b-86e1-4891-9b4b-6c5f3aa6f020 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:00:30.253636 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-f7288db5-2373-4526-982b-1a3a27c7652e tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] 10.222.0.47 "POST /compute/v2.1/servers/9b43c13a-0c7e-45d7-96b0-83fe593a8b08/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.098357 Feb 19 05:00:30.274957 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 41/89] 10.222.0.47 () {60 vars in 1313 bytes} [Fri Feb 19 05:00:28 2021] POST /compute/v2.1/servers/9b43c13a-0c7e-45d7-96b0-83fe593a8b08/os-volume_attachments => generated 194 bytes in 2121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 05:00:30.314335 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-8fdb5f15-7955-45db-ae29-d616122ec159 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:00:30.316290 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-8fdb5f15-7955-45db-ae29-d616122ec159 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] [instance: c74e760d-0b53-4508-ae21-494989132c3a] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:00:30.333100 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-8fdb5f15-7955-45db-ae29-d616122ec159 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:00:30.335133 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-8fdb5f15-7955-45db-ae29-d616122ec159 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:00:30.337296 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-8fdb5f15-7955-45db-ae29-d616122ec159 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:00:30.339134 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-8fdb5f15-7955-45db-ae29-d616122ec159 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:00:30.451415 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-41a7316b-86e1-4891-9b4b-6c5f3aa6f020 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3274478c0a421895f43618dc827ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50941a0cab243e9a320ff22a7648de6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:00:30.464692 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-41a7316b-86e1-4891-9b4b-6c5f3aa6f020 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] 10.222.0.47 "GET /compute/v2.1/servers/be65ea57-bc8d-4bce-80c3-33d8b6007ed1" status: 200 len: 1293 microversion: 2.1 time: 0.295244 Feb 19 05:00:30.467416 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 49/90] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:00:30 2021] GET /compute/v2.1/servers/be65ea57-bc8d-4bce-80c3-33d8b6007ed1 => generated 1293 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:00:30.482254 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [req-5507fb2d-0858-4165-b4f6-1a6b44bf9267 req-fe70c3b3-77ff-4341-8381-b22cb5896d7b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c74e760d-0b53-4508-ae21-494989132c3a", "tag": "e575c436-3f73-4d92-a998-905ed7d2d2f2"}]} {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:00:30.484325 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 05:00:30.484325 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: warnings.warn(msg) Feb 19 05:00:30.507763 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [req-5507fb2d-0858-4165-b4f6-1a6b44bf9267 req-fe70c3b3-77ff-4341-8381-b22cb5896d7b service nova] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:00:30.508271 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [req-5507fb2d-0858-4165-b4f6-1a6b44bf9267 req-fe70c3b3-77ff-4341-8381-b22cb5896d7b service nova] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:00:30.553147 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.compute.server_external_events [req-5507fb2d-0858-4165-b4f6-1a6b44bf9267 req-fe70c3b3-77ff-4341-8381-b22cb5896d7b service nova] Creating event network-changed:e575c436-3f73-4d92-a998-905ed7d2d2f2 for instance c74e760d-0b53-4508-ae21-494989132c3a on hv-cinder-77642 Feb 19 05:00:30.562162 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [req-5507fb2d-0858-4165-b4f6-1a6b44bf9267 req-fe70c3b3-77ff-4341-8381-b22cb5896d7b service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093058 Feb 19 05:00:30.562857 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 50/91] 10.222.0.47 () {64 vars in 1308 bytes} [Fri Feb 19 05:00:30 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 05:00:31.173000 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-390e46e3-11a0-4c30-b3c4-052d99bda99a tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:00:31.173823 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-390e46e3-11a0-4c30-b3c4-052d99bda99a tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] [instance: 798b77ff-c3ca-4c65-a120-db12ad953621] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:00:31.205354 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-390e46e3-11a0-4c30-b3c4-052d99bda99a tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:00:31.209271 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-390e46e3-11a0-4c30-b3c4-052d99bda99a tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:00:31.216224 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-390e46e3-11a0-4c30-b3c4-052d99bda99a tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:00:31.216803 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-390e46e3-11a0-4c30-b3c4-052d99bda99a tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:00:31.940240 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-8fdb5f15-7955-45db-ae29-d616122ec159 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24af0562e2aa43ca9d601be5e16fe9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ee9a43087d5497da3af9fbf68c4572d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:00:31.997758 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-8fdb5f15-7955-45db-ae29-d616122ec159 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] 10.222.0.47 "GET /compute/v2.1/servers/c74e760d-0b53-4508-ae21-494989132c3a" status: 200 len: 1321 microversion: 2.1 time: 1.709877 Feb 19 05:00:32.013768 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 42/92] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:00:30 2021] GET /compute/v2.1/servers/c74e760d-0b53-4508-ae21-494989132c3a => generated 1321 bytes in 1735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:00:32.038143 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-ac4f60df-9f7f-4cd4-b39f-058797db607c tempest-DeleteServersTestJSON-1855409151 tempest-DeleteServersTestJSON-1855409151-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "afff9302-7c73-45f9-b4ab-c45dbd9b3897"}} {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:00:32.040935 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-ac4f60df-9f7f-4cd4-b39f-058797db607c tempest-DeleteServersTestJSON-1855409151 tempest-DeleteServersTestJSON-1855409151-project] [instance: cb93b585-b24f-444e-851a-98f0f13de9b2] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:00:32.058452 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-ac4f60df-9f7f-4cd4-b39f-058797db607c tempest-DeleteServersTestJSON-1855409151 tempest-DeleteServersTestJSON-1855409151-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:00:32.059791 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-ac4f60df-9f7f-4cd4-b39f-058797db607c tempest-DeleteServersTestJSON-1855409151 tempest-DeleteServersTestJSON-1855409151-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:00:32.061753 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-ac4f60df-9f7f-4cd4-b39f-058797db607c tempest-DeleteServersTestJSON-1855409151 tempest-DeleteServersTestJSON-1855409151-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:00:32.063201 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-ac4f60df-9f7f-4cd4-b39f-058797db607c tempest-DeleteServersTestJSON-1855409151 tempest-DeleteServersTestJSON-1855409151-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:00:32.384969 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-390e46e3-11a0-4c30-b3c4-052d99bda99a tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:00:32.413478 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-390e46e3-11a0-4c30-b3c4-052d99bda99a tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:00:32.416420 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-390e46e3-11a0-4c30-b3c4-052d99bda99a tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:00:32.418374 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-390e46e3-11a0-4c30-b3c4-052d99bda99a tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] 10.222.0.47 "GET /compute/v2.1/servers/798b77ff-c3ca-4c65-a120-db12ad953621" status: 200 len: 1408 microversion: 2.20 time: 1.251518 Feb 19 05:00:32.419514 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 51/93] 10.222.0.47 () {60 vars in 1267 bytes} [Fri Feb 19 05:00:31 2021] GET /compute/v2.1/servers/798b77ff-c3ca-4c65-a120-db12ad953621 => generated 1408 bytes in 1254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 05:00:32.435862 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-57e13d74-4ddf-4d90-a0ce-515e43a1684e tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:00:32.437536 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-57e13d74-4ddf-4d90-a0ce-515e43a1684e tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] [instance: be65ea57-bc8d-4bce-80c3-33d8b6007ed1] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:00:32.455781 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-57e13d74-4ddf-4d90-a0ce-515e43a1684e tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:00:32.457151 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-57e13d74-4ddf-4d90-a0ce-515e43a1684e tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:00:32.459722 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-57e13d74-4ddf-4d90-a0ce-515e43a1684e tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:00:32.460949 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-57e13d74-4ddf-4d90-a0ce-515e43a1684e tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:00:33.012222 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-57e13d74-4ddf-4d90-a0ce-515e43a1684e tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3274478c0a421895f43618dc827ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50941a0cab243e9a320ff22a7648de6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:00:33.059922 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-57e13d74-4ddf-4d90-a0ce-515e43a1684e tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] 10.222.0.47 "GET /compute/v2.1/servers/be65ea57-bc8d-4bce-80c3-33d8b6007ed1" status: 200 len: 1360 microversion: 2.1 time: 0.638117 Feb 19 05:00:33.061066 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 52/94] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:00:32 2021] GET /compute/v2.1/servers/be65ea57-bc8d-4bce-80c3-33d8b6007ed1 => generated 1360 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:00:33.072217 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-b5e6533a-26f9-48e1-bbf4-6ca9ab6dfa9d tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:00:33.075854 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-b5e6533a-26f9-48e1-bbf4-6ca9ab6dfa9d tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] [instance: c74e760d-0b53-4508-ae21-494989132c3a] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:00:33.087585 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-b5e6533a-26f9-48e1-bbf4-6ca9ab6dfa9d tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:00:33.088318 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-b5e6533a-26f9-48e1-bbf4-6ca9ab6dfa9d tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:00:33.089233 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-b5e6533a-26f9-48e1-bbf4-6ca9ab6dfa9d tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:00:33.090014 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-b5e6533a-26f9-48e1-bbf4-6ca9ab6dfa9d tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:00:33.459378 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-b5e6533a-26f9-48e1-bbf4-6ca9ab6dfa9d tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24af0562e2aa43ca9d601be5e16fe9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ee9a43087d5497da3af9fbf68c4572d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:00:33.470883 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-b5e6533a-26f9-48e1-bbf4-6ca9ab6dfa9d tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] 10.222.0.47 "GET /compute/v2.1/servers/c74e760d-0b53-4508-ae21-494989132c3a" status: 200 len: 1321 microversion: 2.1 time: 0.407861 Feb 19 05:00:33.471818 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 53/95] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:00:33 2021] GET /compute/v2.1/servers/c74e760d-0b53-4508-ae21-494989132c3a => generated 1321 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:00:33.481370 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-028adfe4-2826-4780-ab58-e2c250db9ada tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:00:33.482654 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-028adfe4-2826-4780-ab58-e2c250db9ada tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] [instance: 798b77ff-c3ca-4c65-a120-db12ad953621] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:00:33.495570 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-028adfe4-2826-4780-ab58-e2c250db9ada tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:00:33.496497 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-028adfe4-2826-4780-ab58-e2c250db9ada tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:00:33.497262 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-028adfe4-2826-4780-ab58-e2c250db9ada tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:00:33.497890 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-028adfe4-2826-4780-ab58-e2c250db9ada tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:00:33.797839 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-028adfe4-2826-4780-ab58-e2c250db9ada tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:00:33.808771 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-028adfe4-2826-4780-ab58-e2c250db9ada tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:00:33.810350 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-028adfe4-2826-4780-ab58-e2c250db9ada tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:00:33.811632 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-028adfe4-2826-4780-ab58-e2c250db9ada tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] 10.222.0.47 "GET /compute/v2.1/servers/798b77ff-c3ca-4c65-a120-db12ad953621" status: 200 len: 1408 microversion: 2.20 time: 0.338351 Feb 19 05:00:33.812548 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 54/96] 10.222.0.47 () {60 vars in 1267 bytes} [Fri Feb 19 05:00:33 2021] GET /compute/v2.1/servers/798b77ff-c3ca-4c65-a120-db12ad953621 => generated 1408 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 05:00:34.093964 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-721b9316-0358-49cb-806a-5a323582f66d tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:00:34.094942 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-721b9316-0358-49cb-806a-5a323582f66d tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] [instance: be65ea57-bc8d-4bce-80c3-33d8b6007ed1] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:00:34.106104 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-721b9316-0358-49cb-806a-5a323582f66d tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:00:34.107285 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-721b9316-0358-49cb-806a-5a323582f66d tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:00:34.109053 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-721b9316-0358-49cb-806a-5a323582f66d tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:00:34.110027 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-721b9316-0358-49cb-806a-5a323582f66d tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:00:34.460236 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-721b9316-0358-49cb-806a-5a323582f66d tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3274478c0a421895f43618dc827ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50941a0cab243e9a320ff22a7648de6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:00:34.470205 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-721b9316-0358-49cb-806a-5a323582f66d tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] 10.222.0.47 "GET /compute/v2.1/servers/be65ea57-bc8d-4bce-80c3-33d8b6007ed1" status: 200 len: 1360 microversion: 2.1 time: 0.380530 Feb 19 05:00:34.481383 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 55/97] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:00:34 2021] GET /compute/v2.1/servers/be65ea57-bc8d-4bce-80c3-33d8b6007ed1 => generated 1360 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 05:00:34.501280 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-0ced1c75-217c-48ec-80dc-99c29e2c174c tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:00:34.502135 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-0ced1c75-217c-48ec-80dc-99c29e2c174c tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] [instance: c74e760d-0b53-4508-ae21-494989132c3a] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:00:34.512233 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-0ced1c75-217c-48ec-80dc-99c29e2c174c tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:00:34.512728 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-0ced1c75-217c-48ec-80dc-99c29e2c174c tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:00:34.513640 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-0ced1c75-217c-48ec-80dc-99c29e2c174c tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:00:34.514336 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-0ced1c75-217c-48ec-80dc-99c29e2c174c tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:00:34.814854 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-0ced1c75-217c-48ec-80dc-99c29e2c174c tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24af0562e2aa43ca9d601be5e16fe9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ee9a43087d5497da3af9fbf68c4572d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:00:34.832576 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-0ced1c75-217c-48ec-80dc-99c29e2c174c tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] 10.222.0.47 "GET /compute/v2.1/servers/c74e760d-0b53-4508-ae21-494989132c3a" status: 200 len: 1321 microversion: 2.1 time: 0.334854 Feb 19 05:00:34.834413 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 56/98] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:00:34 2021] GET /compute/v2.1/servers/c74e760d-0b53-4508-ae21-494989132c3a => generated 1321 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:00:34.843465 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-5f003b9f-8947-4513-a549-25e8a5d9006e tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:00:34.844782 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-5f003b9f-8947-4513-a549-25e8a5d9006e tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] [instance: 798b77ff-c3ca-4c65-a120-db12ad953621] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:00:34.860431 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-5f003b9f-8947-4513-a549-25e8a5d9006e tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:00:34.861180 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-5f003b9f-8947-4513-a549-25e8a5d9006e tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:00:34.862644 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-5f003b9f-8947-4513-a549-25e8a5d9006e tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:00:34.863577 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-5f003b9f-8947-4513-a549-25e8a5d9006e tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:00:35.359615 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-5f003b9f-8947-4513-a549-25e8a5d9006e tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:00:35.391685 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-5f003b9f-8947-4513-a549-25e8a5d9006e tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:00:35.393339 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-5f003b9f-8947-4513-a549-25e8a5d9006e tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:00:35.394580 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-5f003b9f-8947-4513-a549-25e8a5d9006e tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] 10.222.0.47 "GET /compute/v2.1/servers/798b77ff-c3ca-4c65-a120-db12ad953621" status: 200 len: 1408 microversion: 2.20 time: 0.558794 Feb 19 05:00:35.399865 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 57/99] 10.222.0.47 () {60 vars in 1267 bytes} [Fri Feb 19 05:00:34 2021] GET /compute/v2.1/servers/798b77ff-c3ca-4c65-a120-db12ad953621 => generated 1408 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 05:00:35.494128 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-bfcb8061-5081-4212-a1c6-e56d785c3e66 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:00:35.495450 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-bfcb8061-5081-4212-a1c6-e56d785c3e66 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] [instance: be65ea57-bc8d-4bce-80c3-33d8b6007ed1] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:00:35.530292 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-bfcb8061-5081-4212-a1c6-e56d785c3e66 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:00:35.537591 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-bfcb8061-5081-4212-a1c6-e56d785c3e66 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:00:35.541253 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-bfcb8061-5081-4212-a1c6-e56d785c3e66 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:00:35.542058 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-bfcb8061-5081-4212-a1c6-e56d785c3e66 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:00:35.658508 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-ac4f60df-9f7f-4cd4-b39f-058797db607c tempest-DeleteServersTestJSON-1855409151 tempest-DeleteServersTestJSON-1855409151-project] 10.222.0.47 "POST /compute/v2.1/servers/cb93b585-b24f-444e-851a-98f0f13de9b2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.642516 Feb 19 05:00:35.664102 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 43/100] 10.222.0.47 () {60 vars in 1313 bytes} [Fri Feb 19 05:00:32 2021] POST /compute/v2.1/servers/cb93b585-b24f-444e-851a-98f0f13de9b2/os-volume_attachments => generated 194 bytes in 3650 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 05:00:35.856293 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-3b50fa62-7c5f-49f3-b690-0acf64cd91e1 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:00:35.858708 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-3b50fa62-7c5f-49f3-b690-0acf64cd91e1 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] [instance: c74e760d-0b53-4508-ae21-494989132c3a] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:00:35.876515 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-3b50fa62-7c5f-49f3-b690-0acf64cd91e1 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:00:35.877030 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-3b50fa62-7c5f-49f3-b690-0acf64cd91e1 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:00:35.879840 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-3b50fa62-7c5f-49f3-b690-0acf64cd91e1 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:00:35.880457 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-3b50fa62-7c5f-49f3-b690-0acf64cd91e1 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:00:36.267032 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-bfcb8061-5081-4212-a1c6-e56d785c3e66 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3274478c0a421895f43618dc827ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50941a0cab243e9a320ff22a7648de6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:00:36.280256 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-bfcb8061-5081-4212-a1c6-e56d785c3e66 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] 10.222.0.47 "GET /compute/v2.1/servers/be65ea57-bc8d-4bce-80c3-33d8b6007ed1" status: 200 len: 1360 microversion: 2.1 time: 0.795420 Feb 19 05:00:36.287126 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 58/101] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:00:35 2021] GET /compute/v2.1/servers/be65ea57-bc8d-4bce-80c3-33d8b6007ed1 => generated 1360 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:00:36.360842 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-3b50fa62-7c5f-49f3-b690-0acf64cd91e1 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24af0562e2aa43ca9d601be5e16fe9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ee9a43087d5497da3af9fbf68c4572d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:00:36.371893 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-3b50fa62-7c5f-49f3-b690-0acf64cd91e1 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] 10.222.0.47 "GET /compute/v2.1/servers/c74e760d-0b53-4508-ae21-494989132c3a" status: 200 len: 1321 microversion: 2.1 time: 0.520292 Feb 19 05:00:36.373203 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 44/102] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:00:35 2021] GET /compute/v2.1/servers/c74e760d-0b53-4508-ae21-494989132c3a => generated 1321 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:00:36.427641 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-788b9964-9226-4846-840b-b6bc7cc4ad7c tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:00:36.428324 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-788b9964-9226-4846-840b-b6bc7cc4ad7c tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] [instance: 798b77ff-c3ca-4c65-a120-db12ad953621] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:00:36.450862 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-788b9964-9226-4846-840b-b6bc7cc4ad7c tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:00:36.451390 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-788b9964-9226-4846-840b-b6bc7cc4ad7c tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:00:36.452411 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-788b9964-9226-4846-840b-b6bc7cc4ad7c tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:00:36.452817 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-788b9964-9226-4846-840b-b6bc7cc4ad7c tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:00:36.910678 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-788b9964-9226-4846-840b-b6bc7cc4ad7c tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:00:36.939818 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-788b9964-9226-4846-840b-b6bc7cc4ad7c tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:00:36.941988 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-788b9964-9226-4846-840b-b6bc7cc4ad7c tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:00:36.943456 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-788b9964-9226-4846-840b-b6bc7cc4ad7c tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] 10.222.0.47 "GET /compute/v2.1/servers/798b77ff-c3ca-4c65-a120-db12ad953621" status: 200 len: 1408 microversion: 2.20 time: 0.520530 Feb 19 05:00:36.943897 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 59/103] 10.222.0.47 () {60 vars in 1267 bytes} [Fri Feb 19 05:00:36 2021] GET /compute/v2.1/servers/798b77ff-c3ca-4c65-a120-db12ad953621 => generated 1408 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 05:00:37.112380 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [req-49fc7998-0eb5-46f0-b6d6-78370dc83f6f req-e975f5d5-e798-4c71-96b1-08832e228c73 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "be65ea57-bc8d-4bce-80c3-33d8b6007ed1", "tag": "d8d91e89-f645-4300-857f-325550442803"}]} {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:00:37.114148 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 05:00:37.114148 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: warnings.warn(msg) Feb 19 05:00:37.135304 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [req-49fc7998-0eb5-46f0-b6d6-78370dc83f6f req-e975f5d5-e798-4c71-96b1-08832e228c73 service nova] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:00:37.135833 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [req-49fc7998-0eb5-46f0-b6d6-78370dc83f6f req-e975f5d5-e798-4c71-96b1-08832e228c73 service nova] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:00:37.158766 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.compute.server_external_events [req-49fc7998-0eb5-46f0-b6d6-78370dc83f6f req-e975f5d5-e798-4c71-96b1-08832e228c73 service nova] Creating event network-changed:d8d91e89-f645-4300-857f-325550442803 for instance be65ea57-bc8d-4bce-80c3-33d8b6007ed1 on hv-cinder-77642 Feb 19 05:00:37.165478 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [req-49fc7998-0eb5-46f0-b6d6-78370dc83f6f req-e975f5d5-e798-4c71-96b1-08832e228c73 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063162 Feb 19 05:00:37.169452 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 45/104] 10.222.0.47 () {64 vars in 1308 bytes} [Fri Feb 19 05:00:37 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 05:00:37.316072 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-d037dc67-18de-4b87-818a-62ef82e0d36e tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:00:37.317790 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-d037dc67-18de-4b87-818a-62ef82e0d36e tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] [instance: be65ea57-bc8d-4bce-80c3-33d8b6007ed1] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:00:37.327528 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-d037dc67-18de-4b87-818a-62ef82e0d36e tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:00:37.328334 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-d037dc67-18de-4b87-818a-62ef82e0d36e tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:00:37.329593 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-d037dc67-18de-4b87-818a-62ef82e0d36e tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:00:37.330772 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-d037dc67-18de-4b87-818a-62ef82e0d36e tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:00:37.406412 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-1d86b915-944b-4b6e-af5b-f951e6349c10 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:00:37.408119 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-1d86b915-944b-4b6e-af5b-f951e6349c10 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] [instance: c74e760d-0b53-4508-ae21-494989132c3a] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:00:37.423918 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-1d86b915-944b-4b6e-af5b-f951e6349c10 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:00:37.425338 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-1d86b915-944b-4b6e-af5b-f951e6349c10 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:00:37.427081 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-1d86b915-944b-4b6e-af5b-f951e6349c10 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:00:37.428202 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-1d86b915-944b-4b6e-af5b-f951e6349c10 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:00:37.907273 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-d037dc67-18de-4b87-818a-62ef82e0d36e tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3274478c0a421895f43618dc827ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50941a0cab243e9a320ff22a7648de6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:00:37.944515 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-d037dc67-18de-4b87-818a-62ef82e0d36e tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] 10.222.0.47 "GET /compute/v2.1/servers/be65ea57-bc8d-4bce-80c3-33d8b6007ed1" status: 200 len: 1360 microversion: 2.1 time: 0.615587 Feb 19 05:00:37.947577 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 60/105] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:00:37 2021] GET /compute/v2.1/servers/be65ea57-bc8d-4bce-80c3-33d8b6007ed1 => generated 1360 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:00:37.960528 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-1d86b915-944b-4b6e-af5b-f951e6349c10 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24af0562e2aa43ca9d601be5e16fe9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ee9a43087d5497da3af9fbf68c4572d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:00:37.973069 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-9f96a0b5-de1e-48fe-8ad5-01bc56fa2673 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:00:37.974903 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-9f96a0b5-de1e-48fe-8ad5-01bc56fa2673 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] [instance: 798b77ff-c3ca-4c65-a120-db12ad953621] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:00:37.984312 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-1d86b915-944b-4b6e-af5b-f951e6349c10 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] 10.222.0.47 "GET /compute/v2.1/servers/c74e760d-0b53-4508-ae21-494989132c3a" status: 200 len: 1321 microversion: 2.1 time: 0.586213 Feb 19 05:00:37.986375 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 46/106] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:00:37 2021] GET /compute/v2.1/servers/c74e760d-0b53-4508-ae21-494989132c3a => generated 1321 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:00:37.999577 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-9f96a0b5-de1e-48fe-8ad5-01bc56fa2673 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:00:38.000950 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-9f96a0b5-de1e-48fe-8ad5-01bc56fa2673 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:00:38.002825 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-9f96a0b5-de1e-48fe-8ad5-01bc56fa2673 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:00:38.004097 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-9f96a0b5-de1e-48fe-8ad5-01bc56fa2673 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:00:38.474632 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-9f96a0b5-de1e-48fe-8ad5-01bc56fa2673 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:00:38.486787 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-9f96a0b5-de1e-48fe-8ad5-01bc56fa2673 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:00:38.488820 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-9f96a0b5-de1e-48fe-8ad5-01bc56fa2673 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:00:38.490679 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-9f96a0b5-de1e-48fe-8ad5-01bc56fa2673 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] 10.222.0.47 "GET /compute/v2.1/servers/798b77ff-c3ca-4c65-a120-db12ad953621" status: 200 len: 1408 microversion: 2.20 time: 0.529959 Feb 19 05:00:38.503517 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 61/107] 10.222.0.47 () {60 vars in 1267 bytes} [Fri Feb 19 05:00:37 2021] GET /compute/v2.1/servers/798b77ff-c3ca-4c65-a120-db12ad953621 => generated 1408 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 05:00:38.978099 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-ce6a84f1-a022-49f4-a733-3a5450b8d8ad tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:00:38.978808 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-ce6a84f1-a022-49f4-a733-3a5450b8d8ad tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] [instance: be65ea57-bc8d-4bce-80c3-33d8b6007ed1] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:00:38.987916 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-ce6a84f1-a022-49f4-a733-3a5450b8d8ad tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:00:38.988677 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-ce6a84f1-a022-49f4-a733-3a5450b8d8ad tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:00:38.989771 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-ce6a84f1-a022-49f4-a733-3a5450b8d8ad tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:00:38.990480 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-ce6a84f1-a022-49f4-a733-3a5450b8d8ad tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:00:39.013204 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-f8518e2b-047e-424a-9cf2-81064cd76f6f tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:00:39.013897 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-f8518e2b-047e-424a-9cf2-81064cd76f6f tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] [instance: c74e760d-0b53-4508-ae21-494989132c3a] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:00:39.032726 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-f8518e2b-047e-424a-9cf2-81064cd76f6f tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:00:39.033267 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-f8518e2b-047e-424a-9cf2-81064cd76f6f tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:00:39.034161 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-f8518e2b-047e-424a-9cf2-81064cd76f6f tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:00:39.034662 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-f8518e2b-047e-424a-9cf2-81064cd76f6f tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:00:39.391944 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-ce6a84f1-a022-49f4-a733-3a5450b8d8ad tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3274478c0a421895f43618dc827ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50941a0cab243e9a320ff22a7648de6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:00:39.417140 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-ce6a84f1-a022-49f4-a733-3a5450b8d8ad tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] 10.222.0.47 "GET /compute/v2.1/servers/be65ea57-bc8d-4bce-80c3-33d8b6007ed1" status: 200 len: 1360 microversion: 2.1 time: 0.443056 Feb 19 05:00:39.418169 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 47/108] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:00:38 2021] GET /compute/v2.1/servers/be65ea57-bc8d-4bce-80c3-33d8b6007ed1 => generated 1360 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:00:39.461544 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-f8518e2b-047e-424a-9cf2-81064cd76f6f tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24af0562e2aa43ca9d601be5e16fe9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ee9a43087d5497da3af9fbf68c4572d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:00:39.472315 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-f8518e2b-047e-424a-9cf2-81064cd76f6f tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] 10.222.0.47 "GET /compute/v2.1/servers/c74e760d-0b53-4508-ae21-494989132c3a" status: 200 len: 1321 microversion: 2.1 time: 0.463820 Feb 19 05:00:39.484338 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 62/109] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:00:39 2021] GET /compute/v2.1/servers/c74e760d-0b53-4508-ae21-494989132c3a => generated 1321 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:00:39.511999 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-a2f7615e-8b90-404e-b75a-9df0013a0fa0 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:00:39.513438 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-a2f7615e-8b90-404e-b75a-9df0013a0fa0 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] [instance: 798b77ff-c3ca-4c65-a120-db12ad953621] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:00:39.522678 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-a2f7615e-8b90-404e-b75a-9df0013a0fa0 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:00:39.523640 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-a2f7615e-8b90-404e-b75a-9df0013a0fa0 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:00:39.525431 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-a2f7615e-8b90-404e-b75a-9df0013a0fa0 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:00:39.526301 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-a2f7615e-8b90-404e-b75a-9df0013a0fa0 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:00:39.860214 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-a2f7615e-8b90-404e-b75a-9df0013a0fa0 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:00:39.880575 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-a2f7615e-8b90-404e-b75a-9df0013a0fa0 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:00:39.883897 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-a2f7615e-8b90-404e-b75a-9df0013a0fa0 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:00:39.886516 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-a2f7615e-8b90-404e-b75a-9df0013a0fa0 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] 10.222.0.47 "GET /compute/v2.1/servers/798b77ff-c3ca-4c65-a120-db12ad953621" status: 200 len: 1408 microversion: 2.20 time: 0.378549 Feb 19 05:00:39.887605 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 48/110] 10.222.0.47 () {60 vars in 1267 bytes} [Fri Feb 19 05:00:39 2021] GET /compute/v2.1/servers/798b77ff-c3ca-4c65-a120-db12ad953621 => generated 1408 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 19 05:00:40.435859 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-5ffae978-5619-41bc-b852-e83a07871544 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:00:40.436333 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-5ffae978-5619-41bc-b852-e83a07871544 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] [instance: be65ea57-bc8d-4bce-80c3-33d8b6007ed1] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:00:40.446498 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-5ffae978-5619-41bc-b852-e83a07871544 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:00:40.447013 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-5ffae978-5619-41bc-b852-e83a07871544 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:00:40.447907 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-5ffae978-5619-41bc-b852-e83a07871544 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:00:40.448662 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-5ffae978-5619-41bc-b852-e83a07871544 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:00:40.492902 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-69a17bd3-fb70-4c28-b782-2c8d8bc5309a tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:00:40.493939 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-69a17bd3-fb70-4c28-b782-2c8d8bc5309a tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] [instance: c74e760d-0b53-4508-ae21-494989132c3a] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:00:40.537644 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-69a17bd3-fb70-4c28-b782-2c8d8bc5309a tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:00:40.539499 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-69a17bd3-fb70-4c28-b782-2c8d8bc5309a tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:00:40.544031 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-69a17bd3-fb70-4c28-b782-2c8d8bc5309a tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:00:40.544897 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-69a17bd3-fb70-4c28-b782-2c8d8bc5309a tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:00:41.028635 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-5ffae978-5619-41bc-b852-e83a07871544 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3274478c0a421895f43618dc827ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50941a0cab243e9a320ff22a7648de6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:00:41.043998 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-5ffae978-5619-41bc-b852-e83a07871544 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] 10.222.0.47 "GET /compute/v2.1/servers/be65ea57-bc8d-4bce-80c3-33d8b6007ed1" status: 200 len: 1360 microversion: 2.1 time: 0.612194 Feb 19 05:00:41.050501 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 63/111] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:00:40 2021] GET /compute/v2.1/servers/be65ea57-bc8d-4bce-80c3-33d8b6007ed1 => generated 1360 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:00:41.063944 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [req-649b3878-117c-4ac5-b215-52fa104c333b req-34c1c7da-627b-4dd8-979a-97fc646dadec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c74e760d-0b53-4508-ae21-494989132c3a", "name": "network-vif-plugged", "status": "completed", "tag": "e575c436-3f73-4d92-a998-905ed7d2d2f2"}]} {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:00:41.066160 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 05:00:41.066160 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: warnings.warn(msg) Feb 19 05:00:41.100961 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [req-649b3878-117c-4ac5-b215-52fa104c333b req-34c1c7da-627b-4dd8-979a-97fc646dadec service nova] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:00:41.102466 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [req-649b3878-117c-4ac5-b215-52fa104c333b req-34c1c7da-627b-4dd8-979a-97fc646dadec service nova] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:00:41.162354 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.compute.server_external_events [req-649b3878-117c-4ac5-b215-52fa104c333b req-34c1c7da-627b-4dd8-979a-97fc646dadec service nova] Creating event network-vif-plugged:e575c436-3f73-4d92-a998-905ed7d2d2f2 for instance c74e760d-0b53-4508-ae21-494989132c3a on hv-cinder-77642 Feb 19 05:00:41.191520 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [req-649b3878-117c-4ac5-b215-52fa104c333b req-34c1c7da-627b-4dd8-979a-97fc646dadec service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.134103 Feb 19 05:00:41.193277 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 64/112] 10.222.0.47 () {64 vars in 1308 bytes} [Fri Feb 19 05:00:41 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 05:00:41.222115 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-db3f415d-9e22-42c5-89f2-c46b06579224 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:00:41.224387 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-db3f415d-9e22-42c5-89f2-c46b06579224 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] [instance: 798b77ff-c3ca-4c65-a120-db12ad953621] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:00:41.268350 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-db3f415d-9e22-42c5-89f2-c46b06579224 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:00:41.269810 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-db3f415d-9e22-42c5-89f2-c46b06579224 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:00:41.271641 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-db3f415d-9e22-42c5-89f2-c46b06579224 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:00:41.277231 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-db3f415d-9e22-42c5-89f2-c46b06579224 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:00:41.596945 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-69a17bd3-fb70-4c28-b782-2c8d8bc5309a tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24af0562e2aa43ca9d601be5e16fe9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ee9a43087d5497da3af9fbf68c4572d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:00:41.627782 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-69a17bd3-fb70-4c28-b782-2c8d8bc5309a tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] 10.222.0.47 "GET /compute/v2.1/servers/c74e760d-0b53-4508-ae21-494989132c3a" status: 200 len: 1321 microversion: 2.1 time: 1.139431 Feb 19 05:00:41.629255 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 49/113] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:00:40 2021] GET /compute/v2.1/servers/c74e760d-0b53-4508-ae21-494989132c3a => generated 1321 bytes in 1143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 05:00:42.088792 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-6228d829-b907-42ee-bbaf-ec636318a932 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:00:42.089924 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-6228d829-b907-42ee-bbaf-ec636318a932 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] [instance: be65ea57-bc8d-4bce-80c3-33d8b6007ed1] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:00:42.136566 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-6228d829-b907-42ee-bbaf-ec636318a932 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:00:42.137420 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-6228d829-b907-42ee-bbaf-ec636318a932 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:00:42.138970 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-6228d829-b907-42ee-bbaf-ec636318a932 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:00:42.144172 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-6228d829-b907-42ee-bbaf-ec636318a932 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:00:42.246963 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-db3f415d-9e22-42c5-89f2-c46b06579224 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:00:42.301992 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-db3f415d-9e22-42c5-89f2-c46b06579224 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:00:42.306003 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-db3f415d-9e22-42c5-89f2-c46b06579224 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:00:42.308764 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-db3f415d-9e22-42c5-89f2-c46b06579224 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] 10.222.0.47 "GET /compute/v2.1/servers/798b77ff-c3ca-4c65-a120-db12ad953621" status: 200 len: 1408 microversion: 2.20 time: 1.110871 Feb 19 05:00:42.310150 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 65/114] 10.222.0.47 () {60 vars in 1267 bytes} [Fri Feb 19 05:00:41 2021] GET /compute/v2.1/servers/798b77ff-c3ca-4c65-a120-db12ad953621 => generated 1408 bytes in 1114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 05:00:42.653801 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-b3a8c3c0-8b84-4b29-9369-38e4f08124e3 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:00:42.654964 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-b3a8c3c0-8b84-4b29-9369-38e4f08124e3 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] [instance: c74e760d-0b53-4508-ae21-494989132c3a] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:00:42.697918 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-b3a8c3c0-8b84-4b29-9369-38e4f08124e3 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:00:42.699207 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-b3a8c3c0-8b84-4b29-9369-38e4f08124e3 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:00:42.700953 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-b3a8c3c0-8b84-4b29-9369-38e4f08124e3 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:00:42.702069 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-b3a8c3c0-8b84-4b29-9369-38e4f08124e3 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:00:42.819267 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-6228d829-b907-42ee-bbaf-ec636318a932 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3274478c0a421895f43618dc827ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50941a0cab243e9a320ff22a7648de6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:00:42.852824 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-6228d829-b907-42ee-bbaf-ec636318a932 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] 10.222.0.47 "GET /compute/v2.1/servers/be65ea57-bc8d-4bce-80c3-33d8b6007ed1" status: 200 len: 1360 microversion: 2.1 time: 0.772844 Feb 19 05:00:42.855766 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 50/115] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:00:42 2021] GET /compute/v2.1/servers/be65ea57-bc8d-4bce-80c3-33d8b6007ed1 => generated 1360 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:00:43.231400 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [req-d9cded65-55fe-4462-8377-76315bb16700 req-c040fe2d-d515-4b6f-ad13-96f9f777f01b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "798b77ff-c3ca-4c65-a120-db12ad953621", "name": "network-vif-plugged", "status": "completed", "tag": "6af5e97b-75ed-4d80-88eb-6ea5c37a0234"}]} {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:00:43.243825 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 05:00:43.243825 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: warnings.warn(msg) Feb 19 05:00:43.289203 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [req-d9cded65-55fe-4462-8377-76315bb16700 req-c040fe2d-d515-4b6f-ad13-96f9f777f01b service nova] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:00:43.290529 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [req-d9cded65-55fe-4462-8377-76315bb16700 req-c040fe2d-d515-4b6f-ad13-96f9f777f01b service nova] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:00:43.347373 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.compute.server_external_events [req-d9cded65-55fe-4462-8377-76315bb16700 req-c040fe2d-d515-4b6f-ad13-96f9f777f01b service nova] Creating event network-vif-plugged:6af5e97b-75ed-4d80-88eb-6ea5c37a0234 for instance 798b77ff-c3ca-4c65-a120-db12ad953621 on hv-cinder-77642 Feb 19 05:00:43.360902 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [req-d9cded65-55fe-4462-8377-76315bb16700 req-c040fe2d-d515-4b6f-ad13-96f9f777f01b service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.141779 Feb 19 05:00:43.363137 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 51/116] 10.222.0.47 () {64 vars in 1308 bytes} [Fri Feb 19 05:00:43 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 05:00:43.375984 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-312f6a8c-9ef7-4729-ac39-f9adf36b3d3e tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:00:43.378098 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-312f6a8c-9ef7-4729-ac39-f9adf36b3d3e tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] [instance: 798b77ff-c3ca-4c65-a120-db12ad953621] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:00:43.397787 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-312f6a8c-9ef7-4729-ac39-f9adf36b3d3e tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:00:43.399106 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-312f6a8c-9ef7-4729-ac39-f9adf36b3d3e tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:00:43.411626 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-312f6a8c-9ef7-4729-ac39-f9adf36b3d3e tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:00:43.415276 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-312f6a8c-9ef7-4729-ac39-f9adf36b3d3e tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:00:43.494791 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-b3a8c3c0-8b84-4b29-9369-38e4f08124e3 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24af0562e2aa43ca9d601be5e16fe9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ee9a43087d5497da3af9fbf68c4572d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:00:43.523463 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-b3a8c3c0-8b84-4b29-9369-38e4f08124e3 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] 10.222.0.47 "GET /compute/v2.1/servers/c74e760d-0b53-4508-ae21-494989132c3a" status: 200 len: 1321 microversion: 2.1 time: 0.877941 Feb 19 05:00:43.525709 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 66/117] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:00:42 2021] GET /compute/v2.1/servers/c74e760d-0b53-4508-ae21-494989132c3a => generated 1321 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:00:43.893017 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-afb06892-81ea-4e4c-8796-a62696262aca tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:00:43.896427 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-afb06892-81ea-4e4c-8796-a62696262aca tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] [instance: be65ea57-bc8d-4bce-80c3-33d8b6007ed1] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:00:43.976098 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-afb06892-81ea-4e4c-8796-a62696262aca tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:00:43.978292 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-afb06892-81ea-4e4c-8796-a62696262aca tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:00:43.983729 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-afb06892-81ea-4e4c-8796-a62696262aca tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:00:43.988560 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-afb06892-81ea-4e4c-8796-a62696262aca tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:00:44.325777 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-312f6a8c-9ef7-4729-ac39-f9adf36b3d3e tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:00:44.351698 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-312f6a8c-9ef7-4729-ac39-f9adf36b3d3e tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:00:44.356024 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-312f6a8c-9ef7-4729-ac39-f9adf36b3d3e tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:00:44.359087 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-312f6a8c-9ef7-4729-ac39-f9adf36b3d3e tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] 10.222.0.47 "GET /compute/v2.1/servers/798b77ff-c3ca-4c65-a120-db12ad953621" status: 200 len: 1408 microversion: 2.20 time: 0.992572 Feb 19 05:00:44.361501 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 52/118] 10.222.0.47 () {60 vars in 1267 bytes} [Fri Feb 19 05:00:43 2021] GET /compute/v2.1/servers/798b77ff-c3ca-4c65-a120-db12ad953621 => generated 1408 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 05:00:44.560663 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-d01cf2a8-6384-4f10-a51c-464b3cb55a61 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:00:44.562347 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-d01cf2a8-6384-4f10-a51c-464b3cb55a61 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] [instance: c74e760d-0b53-4508-ae21-494989132c3a] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:00:44.581811 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-d01cf2a8-6384-4f10-a51c-464b3cb55a61 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:00:44.583671 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-d01cf2a8-6384-4f10-a51c-464b3cb55a61 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:00:44.587569 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-d01cf2a8-6384-4f10-a51c-464b3cb55a61 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:00:44.588881 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-d01cf2a8-6384-4f10-a51c-464b3cb55a61 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:00:44.953039 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-afb06892-81ea-4e4c-8796-a62696262aca tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3274478c0a421895f43618dc827ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50941a0cab243e9a320ff22a7648de6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:00:44.980925 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-afb06892-81ea-4e4c-8796-a62696262aca tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] 10.222.0.47 "GET /compute/v2.1/servers/be65ea57-bc8d-4bce-80c3-33d8b6007ed1" status: 200 len: 1360 microversion: 2.1 time: 1.095856 Feb 19 05:00:44.982109 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 67/119] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:00:43 2021] GET /compute/v2.1/servers/be65ea57-bc8d-4bce-80c3-33d8b6007ed1 => generated 1360 bytes in 1098 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 05:00:44.995589 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-86955a82-1f89-4960-82ab-12cc569c976d tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-610415681", "imageRef": "53cdf9de-e495-4ca8-845f-6be2bf32cecb", "flavorRef": "452", "networks": [{"uuid": "f995194d-dcd5-48ad-baed-944751a68000"}]}} {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:00:45.098771 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-d01cf2a8-6384-4f10-a51c-464b3cb55a61 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24af0562e2aa43ca9d601be5e16fe9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ee9a43087d5497da3af9fbf68c4572d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:00:45.120017 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-d01cf2a8-6384-4f10-a51c-464b3cb55a61 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] 10.222.0.47 "GET /compute/v2.1/servers/c74e760d-0b53-4508-ae21-494989132c3a" status: 200 len: 1515 microversion: 2.1 time: 0.568514 Feb 19 05:00:45.135493 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 53/120] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:00:44 2021] GET /compute/v2.1/servers/c74e760d-0b53-4508-ae21-494989132c3a => generated 1515 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:00:45.151522 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.network.neutron [None req-86955a82-1f89-4960-82ab-12cc569c976d tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] validate_networks() for [('f995194d-dcd5-48ad-baed-944751a68000', None, None, None)] {{(pid=98154) validate_networks /opt/stack/nova/nova/network/neutron.py:2345}} Feb 19 05:00:45.157174 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-898cb23a-6a3a-4324-b670-d4bc17820dbc tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:00:45.159728 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-898cb23a-6a3a-4324-b670-d4bc17820dbc tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] [instance: c74e760d-0b53-4508-ae21-494989132c3a] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:00:45.175775 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-898cb23a-6a3a-4324-b670-d4bc17820dbc tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:00:45.177670 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-898cb23a-6a3a-4324-b670-d4bc17820dbc tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:00:45.179494 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-898cb23a-6a3a-4324-b670-d4bc17820dbc tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:00:45.180953 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-898cb23a-6a3a-4324-b670-d4bc17820dbc tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:00:45.328257 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.objects.instance [None req-898cb23a-6a3a-4324-b670-d4bc17820dbc tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lazy-loading 'flavor' on Instance uuid c74e760d-0b53-4508-ae21-494989132c3a {{(pid=98153) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Feb 19 05:00:45.681099 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-898cb23a-6a3a-4324-b670-d4bc17820dbc tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] 10.222.0.47 "POST /compute/v2.1/servers/c74e760d-0b53-4508-ae21-494989132c3a/action" status: 200 len: 32 microversion: 2.1 time: 0.531849 Feb 19 05:00:45.682481 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 54/121] 10.222.0.47 () {60 vars in 1268 bytes} [Fri Feb 19 05:00:45 2021] POST /compute/v2.1/servers/c74e760d-0b53-4508-ae21-494989132c3a/action => generated 32 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Feb 19 05:00:45.696205 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-f1579910-5c6b-4f95-acb9-16bd2b431c0d tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:00:45.696995 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-f1579910-5c6b-4f95-acb9-16bd2b431c0d tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] [instance: 798b77ff-c3ca-4c65-a120-db12ad953621] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:00:45.706809 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-f1579910-5c6b-4f95-acb9-16bd2b431c0d tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:00:45.707353 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-f1579910-5c6b-4f95-acb9-16bd2b431c0d tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:00:45.709280 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-f1579910-5c6b-4f95-acb9-16bd2b431c0d tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:00:45.709727 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-f1579910-5c6b-4f95-acb9-16bd2b431c0d tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:00:46.481350 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.virt.hardware [None req-86955a82-1f89-4960-82ab-12cc569c976d tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Flavor limits 0:0:0 {{(pid=98154) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 19 05:00:46.482147 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.virt.hardware [None req-86955a82-1f89-4960-82ab-12cc569c976d tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Image limits 0:0:0 {{(pid=98154) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Feb 19 05:00:46.482873 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.virt.hardware [None req-86955a82-1f89-4960-82ab-12cc569c976d tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Flavor pref 0:0:0 {{(pid=98154) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 19 05:00:46.483473 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.virt.hardware [None req-86955a82-1f89-4960-82ab-12cc569c976d tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Image pref 0:0:0 {{(pid=98154) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Feb 19 05:00:46.484073 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.virt.hardware [None req-86955a82-1f89-4960-82ab-12cc569c976d tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98154) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Feb 19 05:00:46.502790 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-f1579910-5c6b-4f95-acb9-16bd2b431c0d tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:00:46.518472 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-86955a82-1f89-4960-82ab-12cc569c976d tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:00:46.519136 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-86955a82-1f89-4960-82ab-12cc569c976d tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:00:46.527034 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-86955a82-1f89-4960-82ab-12cc569c976d tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:00:46.531534 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-86955a82-1f89-4960-82ab-12cc569c976d tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:00:46.533872 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-f1579910-5c6b-4f95-acb9-16bd2b431c0d tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:00:46.542317 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-f1579910-5c6b-4f95-acb9-16bd2b431c0d tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:00:46.545701 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-f1579910-5c6b-4f95-acb9-16bd2b431c0d tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] 10.222.0.47 "GET /compute/v2.1/servers/798b77ff-c3ca-4c65-a120-db12ad953621" status: 200 len: 1408 microversion: 2.20 time: 0.857001 Feb 19 05:00:46.548482 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 55/122] 10.222.0.47 () {60 vars in 1267 bytes} [Fri Feb 19 05:00:45 2021] GET /compute/v2.1/servers/798b77ff-c3ca-4c65-a120-db12ad953621 => generated 1408 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 05:00:46.561058 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-5779471c-1f7b-4676-9c77-061ba7d3ad08 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:00:46.562631 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-5779471c-1f7b-4676-9c77-061ba7d3ad08 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] [instance: c74e760d-0b53-4508-ae21-494989132c3a] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:00:46.583358 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-5779471c-1f7b-4676-9c77-061ba7d3ad08 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:00:46.586709 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-5779471c-1f7b-4676-9c77-061ba7d3ad08 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:00:46.589115 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-5779471c-1f7b-4676-9c77-061ba7d3ad08 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:00:46.590752 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-5779471c-1f7b-4676-9c77-061ba7d3ad08 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:00:46.608767 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.quota [None req-86955a82-1f89-4960-82ab-12cc569c976d tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Getting quotas for project aa473e12960449bbb0713a709e0abe4e. Resources: {'instances', 'ram', 'cores'} {{(pid=98154) _get_quotas /opt/stack/nova/nova/quota.py:388}} Feb 19 05:00:46.615538 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.quota [None req-86955a82-1f89-4960-82ab-12cc569c976d tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Getting quotas for user 628d846121a14be78329ccc727c8869d and project aa473e12960449bbb0713a709e0abe4e. Resources: {'instances', 'ram', 'cores'} {{(pid=98154) _get_quotas /opt/stack/nova/nova/quota.py:380}} Feb 19 05:00:46.631168 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-86955a82-1f89-4960-82ab-12cc569c976d tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Going to run 1 instances... {{(pid=98154) _provision_instances /opt/stack/nova/nova/compute/api.py:1264}} Feb 19 05:00:46.634065 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-86955a82-1f89-4960-82ab-12cc569c976d tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] [instance: 2182cbf3-8c7a-4e32-937d-baea03567dee] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='53cdf9de-e495-4ca8-845f-6be2bf32cecb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98154) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1666}} Feb 19 05:00:46.719865 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-86955a82-1f89-4960-82ab-12cc569c976d tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.736688 Feb 19 05:00:46.721154 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 68/123] 10.222.0.47 () {60 vars in 1137 bytes} [Fri Feb 19 05:00:44 2021] POST /compute/v2.1/servers => generated 380 bytes in 1738 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 19 05:00:46.734918 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-2db4e29f-1626-4ece-b07c-1abdef077001 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:00:46.735649 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-2db4e29f-1626-4ece-b07c-1abdef077001 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] [instance: be65ea57-bc8d-4bce-80c3-33d8b6007ed1] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:00:46.748601 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-2db4e29f-1626-4ece-b07c-1abdef077001 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:00:46.749123 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-2db4e29f-1626-4ece-b07c-1abdef077001 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:00:46.749997 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-2db4e29f-1626-4ece-b07c-1abdef077001 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:00:46.750503 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-2db4e29f-1626-4ece-b07c-1abdef077001 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:00:47.209600 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-5779471c-1f7b-4676-9c77-061ba7d3ad08 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24af0562e2aa43ca9d601be5e16fe9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ee9a43087d5497da3af9fbf68c4572d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:00:47.227313 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-5779471c-1f7b-4676-9c77-061ba7d3ad08 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] 10.222.0.47 "GET /compute/v2.1/servers/c74e760d-0b53-4508-ae21-494989132c3a" status: 200 len: 1521 microversion: 2.1 time: 0.675962 Feb 19 05:00:47.228663 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 56/124] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:00:46 2021] GET /compute/v2.1/servers/c74e760d-0b53-4508-ae21-494989132c3a => generated 1521 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:00:47.239936 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-a54c6f58-50b9-40dc-a01d-1dc0d0e28e3e tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:00:47.241571 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-a54c6f58-50b9-40dc-a01d-1dc0d0e28e3e tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] [instance: 2182cbf3-8c7a-4e32-937d-baea03567dee] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:00:47.298851 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-2db4e29f-1626-4ece-b07c-1abdef077001 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3274478c0a421895f43618dc827ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50941a0cab243e9a320ff22a7648de6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:00:47.311088 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-2db4e29f-1626-4ece-b07c-1abdef077001 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] 10.222.0.47 "GET /compute/v2.1/servers/be65ea57-bc8d-4bce-80c3-33d8b6007ed1" status: 200 len: 1360 microversion: 2.1 time: 0.588482 Feb 19 05:00:47.312635 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 69/125] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:00:46 2021] GET /compute/v2.1/servers/be65ea57-bc8d-4bce-80c3-33d8b6007ed1 => generated 1360 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:00:47.397642 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-a54c6f58-50b9-40dc-a01d-1dc0d0e28e3e tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628d846121a14be78329ccc727c8869d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa473e12960449bbb0713a709e0abe4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:00:47.406765 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-a54c6f58-50b9-40dc-a01d-1dc0d0e28e3e tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] 10.222.0.47 "GET /compute/v2.1/servers/2182cbf3-8c7a-4e32-937d-baea03567dee" status: 200 len: 1217 microversion: 2.1 time: 0.176379 Feb 19 05:00:47.407487 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 57/126] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:00:47 2021] GET /compute/v2.1/servers/2182cbf3-8c7a-4e32-937d-baea03567dee => generated 1217 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:00:47.568109 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-720b0b35-f1b2-425a-a666-a94f7409fb53 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:00:47.569292 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-720b0b35-f1b2-425a-a666-a94f7409fb53 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] [instance: 798b77ff-c3ca-4c65-a120-db12ad953621] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:00:47.577581 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-720b0b35-f1b2-425a-a666-a94f7409fb53 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:00:47.578103 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-720b0b35-f1b2-425a-a666-a94f7409fb53 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:00:47.578981 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-720b0b35-f1b2-425a-a666-a94f7409fb53 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:00:47.579530 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-720b0b35-f1b2-425a-a666-a94f7409fb53 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:00:47.823511 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-720b0b35-f1b2-425a-a666-a94f7409fb53 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:00:47.835127 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-720b0b35-f1b2-425a-a666-a94f7409fb53 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:00:47.836935 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-720b0b35-f1b2-425a-a666-a94f7409fb53 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:00:47.838252 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-720b0b35-f1b2-425a-a666-a94f7409fb53 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] 10.222.0.47 "GET /compute/v2.1/servers/798b77ff-c3ca-4c65-a120-db12ad953621" status: 200 len: 1600 microversion: 2.20 time: 0.275137 Feb 19 05:00:47.844285 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 70/127] 10.222.0.47 () {60 vars in 1267 bytes} [Fri Feb 19 05:00:47 2021] GET /compute/v2.1/servers/798b77ff-c3ca-4c65-a120-db12ad953621 => generated 1600 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 19 05:00:47.863093 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-fff847f5-2c0b-46c4-937a-75d8af48684f tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:00:47.864145 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-fff847f5-2c0b-46c4-937a-75d8af48684f tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] [instance: 798b77ff-c3ca-4c65-a120-db12ad953621] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:00:47.880193 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-fff847f5-2c0b-46c4-937a-75d8af48684f tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:00:47.881085 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-fff847f5-2c0b-46c4-937a-75d8af48684f tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:00:47.882688 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-fff847f5-2c0b-46c4-937a-75d8af48684f tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:00:47.883646 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-fff847f5-2c0b-46c4-937a-75d8af48684f tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:00:48.220673 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-fff847f5-2c0b-46c4-937a-75d8af48684f tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] 10.222.0.47 "GET /compute/v2.1/servers/798b77ff-c3ca-4c65-a120-db12ad953621/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.365017 Feb 19 05:00:48.222261 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 58/128] 10.222.0.47 () {60 vars in 1306 bytes} [Fri Feb 19 05:00:47 2021] GET /compute/v2.1/servers/798b77ff-c3ca-4c65-a120-db12ad953621/os-interface => generated 284 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 19 05:00:48.251993 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-a002a58c-9bae-43e3-8707-f025741283f8 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:00:48.264404 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-a002a58c-9bae-43e3-8707-f025741283f8 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] [instance: c74e760d-0b53-4508-ae21-494989132c3a] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:00:48.278530 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-a002a58c-9bae-43e3-8707-f025741283f8 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:00:48.279733 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-a002a58c-9bae-43e3-8707-f025741283f8 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:00:48.281591 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-a002a58c-9bae-43e3-8707-f025741283f8 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:00:48.282895 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-a002a58c-9bae-43e3-8707-f025741283f8 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:00:48.348072 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-0c7fb509-b2c7-4c6d-bb2d-fca53aee98c6 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:00:48.351575 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-0c7fb509-b2c7-4c6d-bb2d-fca53aee98c6 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] [instance: be65ea57-bc8d-4bce-80c3-33d8b6007ed1] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:00:48.370853 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-0c7fb509-b2c7-4c6d-bb2d-fca53aee98c6 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:00:48.372195 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-0c7fb509-b2c7-4c6d-bb2d-fca53aee98c6 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:00:48.373948 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-0c7fb509-b2c7-4c6d-bb2d-fca53aee98c6 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:00:48.374943 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-0c7fb509-b2c7-4c6d-bb2d-fca53aee98c6 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:00:48.987689 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-0c7fb509-b2c7-4c6d-bb2d-fca53aee98c6 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3274478c0a421895f43618dc827ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50941a0cab243e9a320ff22a7648de6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:00:49.010026 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-a002a58c-9bae-43e3-8707-f025741283f8 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24af0562e2aa43ca9d601be5e16fe9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ee9a43087d5497da3af9fbf68c4572d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:00:49.029248 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-0c7fb509-b2c7-4c6d-bb2d-fca53aee98c6 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] 10.222.0.47 "GET /compute/v2.1/servers/be65ea57-bc8d-4bce-80c3-33d8b6007ed1" status: 200 len: 1360 microversion: 2.1 time: 0.700454 Feb 19 05:00:49.030457 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 59/129] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:00:48 2021] GET /compute/v2.1/servers/be65ea57-bc8d-4bce-80c3-33d8b6007ed1 => generated 1360 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:00:49.065981 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-a002a58c-9bae-43e3-8707-f025741283f8 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] 10.222.0.47 "GET /compute/v2.1/servers/c74e760d-0b53-4508-ae21-494989132c3a" status: 200 len: 1521 microversion: 2.1 time: 0.820360 Feb 19 05:00:49.067752 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 71/130] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:00:48 2021] GET /compute/v2.1/servers/c74e760d-0b53-4508-ae21-494989132c3a => generated 1521 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:00:49.071983 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-53bb97d7-3352-4c92-8f61-948ccb3ca632 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:00:49.073765 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-53bb97d7-3352-4c92-8f61-948ccb3ca632 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] [instance: 2182cbf3-8c7a-4e32-937d-baea03567dee] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:00:49.087670 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-53bb97d7-3352-4c92-8f61-948ccb3ca632 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:00:49.088178 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-53bb97d7-3352-4c92-8f61-948ccb3ca632 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:00:49.089034 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-53bb97d7-3352-4c92-8f61-948ccb3ca632 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:00:49.089523 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-53bb97d7-3352-4c92-8f61-948ccb3ca632 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:00:49.282360 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-53bb97d7-3352-4c92-8f61-948ccb3ca632 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628d846121a14be78329ccc727c8869d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa473e12960449bbb0713a709e0abe4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:00:49.304969 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-53bb97d7-3352-4c92-8f61-948ccb3ca632 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] 10.222.0.47 "GET /compute/v2.1/servers/2182cbf3-8c7a-4e32-937d-baea03567dee" status: 200 len: 1221 microversion: 2.1 time: 0.243377 Feb 19 05:00:49.306849 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 60/131] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:00:49 2021] GET /compute/v2.1/servers/2182cbf3-8c7a-4e32-937d-baea03567dee => generated 1221 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:00:50.064596 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-59815e75-0cb5-4a29-a5cf-a543cb780fdd tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:00:50.065798 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-59815e75-0cb5-4a29-a5cf-a543cb780fdd tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] [instance: be65ea57-bc8d-4bce-80c3-33d8b6007ed1] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:00:50.090424 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-59815e75-0cb5-4a29-a5cf-a543cb780fdd tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:00:50.092075 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-59815e75-0cb5-4a29-a5cf-a543cb780fdd tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:00:50.094071 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-59815e75-0cb5-4a29-a5cf-a543cb780fdd tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:00:50.095916 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-59815e75-0cb5-4a29-a5cf-a543cb780fdd tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:00:50.111742 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-c7e2d1fc-cff7-4d4c-9aa9-3e277ca5e2d4 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:00:50.112358 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-c7e2d1fc-cff7-4d4c-9aa9-3e277ca5e2d4 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] [instance: c74e760d-0b53-4508-ae21-494989132c3a] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:00:50.142211 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-c7e2d1fc-cff7-4d4c-9aa9-3e277ca5e2d4 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:00:50.143122 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-c7e2d1fc-cff7-4d4c-9aa9-3e277ca5e2d4 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:00:50.144536 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-c7e2d1fc-cff7-4d4c-9aa9-3e277ca5e2d4 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:00:50.156006 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-c7e2d1fc-cff7-4d4c-9aa9-3e277ca5e2d4 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:00:50.839664 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-59815e75-0cb5-4a29-a5cf-a543cb780fdd tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3274478c0a421895f43618dc827ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50941a0cab243e9a320ff22a7648de6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:00:50.855021 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-59815e75-0cb5-4a29-a5cf-a543cb780fdd tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] 10.222.0.47 "GET /compute/v2.1/servers/be65ea57-bc8d-4bce-80c3-33d8b6007ed1" status: 200 len: 1360 microversion: 2.1 time: 0.795895 Feb 19 05:00:50.856055 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 72/132] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:00:50 2021] GET /compute/v2.1/servers/be65ea57-bc8d-4bce-80c3-33d8b6007ed1 => generated 1360 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:00:50.864792 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-8c4f7cbe-dd1d-418f-8835-79118ba5f8a4 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:00:50.865476 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-8c4f7cbe-dd1d-418f-8835-79118ba5f8a4 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] [instance: 2182cbf3-8c7a-4e32-937d-baea03567dee] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:00:50.898282 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-8c4f7cbe-dd1d-418f-8835-79118ba5f8a4 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:00:50.898650 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-8c4f7cbe-dd1d-418f-8835-79118ba5f8a4 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:00:50.899779 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-8c4f7cbe-dd1d-418f-8835-79118ba5f8a4 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:00:50.900470 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-8c4f7cbe-dd1d-418f-8835-79118ba5f8a4 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:00:50.956712 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-c7e2d1fc-cff7-4d4c-9aa9-3e277ca5e2d4 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24af0562e2aa43ca9d601be5e16fe9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ee9a43087d5497da3af9fbf68c4572d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:00:50.980468 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-c7e2d1fc-cff7-4d4c-9aa9-3e277ca5e2d4 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] 10.222.0.47 "GET /compute/v2.1/servers/c74e760d-0b53-4508-ae21-494989132c3a" status: 200 len: 1521 microversion: 2.1 time: 0.882176 Feb 19 05:00:50.982127 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 61/133] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:00:50 2021] GET /compute/v2.1/servers/c74e760d-0b53-4508-ae21-494989132c3a => generated 1521 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:00:51.264421 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-8c4f7cbe-dd1d-418f-8835-79118ba5f8a4 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628d846121a14be78329ccc727c8869d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa473e12960449bbb0713a709e0abe4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:00:51.291509 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-8c4f7cbe-dd1d-418f-8835-79118ba5f8a4 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] 10.222.0.47 "GET /compute/v2.1/servers/2182cbf3-8c7a-4e32-937d-baea03567dee" status: 200 len: 1269 microversion: 2.1 time: 0.430452 Feb 19 05:00:51.292235 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 73/134] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:00:50 2021] GET /compute/v2.1/servers/2182cbf3-8c7a-4e32-937d-baea03567dee => generated 1269 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:00:51.896379 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-6530366c-b0ba-45a1-94eb-b99a6a98320f tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:00:51.904800 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-6530366c-b0ba-45a1-94eb-b99a6a98320f tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] [instance: be65ea57-bc8d-4bce-80c3-33d8b6007ed1] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:00:51.915450 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-a501a6b6-bd82-4ea8-bd74-d1d8f3aaa30f tempest-DeleteServersTestJSON-1855409151 tempest-DeleteServersTestJSON-1855409151-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:00:51.916257 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-a501a6b6-bd82-4ea8-bd74-d1d8f3aaa30f tempest-DeleteServersTestJSON-1855409151 tempest-DeleteServersTestJSON-1855409151-project] [instance: cb93b585-b24f-444e-851a-98f0f13de9b2] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:00:51.939412 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-a501a6b6-bd82-4ea8-bd74-d1d8f3aaa30f tempest-DeleteServersTestJSON-1855409151 tempest-DeleteServersTestJSON-1855409151-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:00:51.952750 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-a501a6b6-bd82-4ea8-bd74-d1d8f3aaa30f tempest-DeleteServersTestJSON-1855409151 tempest-DeleteServersTestJSON-1855409151-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:00:51.953987 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-a501a6b6-bd82-4ea8-bd74-d1d8f3aaa30f tempest-DeleteServersTestJSON-1855409151 tempest-DeleteServersTestJSON-1855409151-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:00:51.964173 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-a501a6b6-bd82-4ea8-bd74-d1d8f3aaa30f tempest-DeleteServersTestJSON-1855409151 tempest-DeleteServersTestJSON-1855409151-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:00:51.965096 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-6530366c-b0ba-45a1-94eb-b99a6a98320f tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:00:51.966031 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-6530366c-b0ba-45a1-94eb-b99a6a98320f tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:00:51.979626 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-6530366c-b0ba-45a1-94eb-b99a6a98320f tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:00:51.980741 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-6530366c-b0ba-45a1-94eb-b99a6a98320f tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:00:52.126036 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-a501a6b6-bd82-4ea8-bd74-d1d8f3aaa30f tempest-DeleteServersTestJSON-1855409151 tempest-DeleteServersTestJSON-1855409151-project] [instance: cb93b585-b24f-444e-851a-98f0f13de9b2] Going to try to terminate instance {{(pid=98154) delete /opt/stack/nova/nova/compute/api.py:2540}} Feb 19 05:00:52.416642 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-a501a6b6-bd82-4ea8-bd74-d1d8f3aaa30f tempest-DeleteServersTestJSON-1855409151 tempest-DeleteServersTestJSON-1855409151-project] 10.222.0.47 "DELETE /compute/v2.1/servers/cb93b585-b24f-444e-851a-98f0f13de9b2" status: 204 len: 0 microversion: 2.1 time: 0.504889 Feb 19 05:00:52.417423 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 74/135] 10.222.0.47 () {58 vars in 1229 bytes} [Fri Feb 19 05:00:51 2021] DELETE /compute/v2.1/servers/cb93b585-b24f-444e-851a-98f0f13de9b2 => generated 0 bytes in 507 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Feb 19 05:00:52.427576 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-4669707c-b24f-4628-b420-d7c72e130e57 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:00:52.432360 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-4669707c-b24f-4628-b420-d7c72e130e57 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] [instance: c74e760d-0b53-4508-ae21-494989132c3a] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:00:52.453157 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-4669707c-b24f-4628-b420-d7c72e130e57 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:00:52.453924 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-4669707c-b24f-4628-b420-d7c72e130e57 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:00:52.455464 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-4669707c-b24f-4628-b420-d7c72e130e57 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:00:52.456204 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-4669707c-b24f-4628-b420-d7c72e130e57 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:00:53.113597 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-6530366c-b0ba-45a1-94eb-b99a6a98320f tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3274478c0a421895f43618dc827ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50941a0cab243e9a320ff22a7648de6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:00:53.155037 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-6530366c-b0ba-45a1-94eb-b99a6a98320f tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] 10.222.0.47 "GET /compute/v2.1/servers/be65ea57-bc8d-4bce-80c3-33d8b6007ed1" status: 200 len: 1360 microversion: 2.1 time: 1.267761 Feb 19 05:00:53.169556 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 62/136] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:00:51 2021] GET /compute/v2.1/servers/be65ea57-bc8d-4bce-80c3-33d8b6007ed1 => generated 1360 bytes in 1284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:00:53.180254 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-77956ab0-bf15-4675-a94a-a64227c8f8ae tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:00:53.181760 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-77956ab0-bf15-4675-a94a-a64227c8f8ae tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] [instance: 2182cbf3-8c7a-4e32-937d-baea03567dee] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:00:53.198064 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-77956ab0-bf15-4675-a94a-a64227c8f8ae tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:00:53.199525 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-77956ab0-bf15-4675-a94a-a64227c8f8ae tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:00:53.201693 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-77956ab0-bf15-4675-a94a-a64227c8f8ae tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:00:53.202798 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-77956ab0-bf15-4675-a94a-a64227c8f8ae tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:00:53.511808 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-77956ab0-bf15-4675-a94a-a64227c8f8ae tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628d846121a14be78329ccc727c8869d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa473e12960449bbb0713a709e0abe4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:00:53.545160 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-77956ab0-bf15-4675-a94a-a64227c8f8ae tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] 10.222.0.47 "GET /compute/v2.1/servers/2182cbf3-8c7a-4e32-937d-baea03567dee" status: 200 len: 1275 microversion: 2.1 time: 0.373138 Feb 19 05:00:53.556921 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 63/137] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:00:53 2021] GET /compute/v2.1/servers/2182cbf3-8c7a-4e32-937d-baea03567dee => generated 1275 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:00:53.575779 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-1430f093-61a7-4014-a064-36d42f22242d tempest-DeleteServersTestJSON-1855409151 tempest-DeleteServersTestJSON-1855409151-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:00:53.577816 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-1430f093-61a7-4014-a064-36d42f22242d tempest-DeleteServersTestJSON-1855409151 tempest-DeleteServersTestJSON-1855409151-project] [instance: cb93b585-b24f-444e-851a-98f0f13de9b2] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:00:53.599095 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-1430f093-61a7-4014-a064-36d42f22242d tempest-DeleteServersTestJSON-1855409151 tempest-DeleteServersTestJSON-1855409151-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:00:53.600353 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-1430f093-61a7-4014-a064-36d42f22242d tempest-DeleteServersTestJSON-1855409151 tempest-DeleteServersTestJSON-1855409151-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:00:53.602151 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-1430f093-61a7-4014-a064-36d42f22242d tempest-DeleteServersTestJSON-1855409151 tempest-DeleteServersTestJSON-1855409151-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:00:53.603233 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-1430f093-61a7-4014-a064-36d42f22242d tempest-DeleteServersTestJSON-1855409151 tempest-DeleteServersTestJSON-1855409151-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:00:53.629141 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-4669707c-b24f-4628-b420-d7c72e130e57 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24af0562e2aa43ca9d601be5e16fe9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ee9a43087d5497da3af9fbf68c4572d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:00:53.650766 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-4669707c-b24f-4628-b420-d7c72e130e57 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] 10.222.0.47 "GET /compute/v2.1/servers/c74e760d-0b53-4508-ae21-494989132c3a" status: 200 len: 1521 microversion: 2.1 time: 1.228378 Feb 19 05:00:53.651448 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 75/138] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:00:52 2021] GET /compute/v2.1/servers/c74e760d-0b53-4508-ae21-494989132c3a => generated 1521 bytes in 1233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:00:53.656841 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [req-537e4d4a-cf3f-4471-a2c1-1e11b0b9e3d4 req-fb6a6f03-0a8b-4a2e-a04b-5945a3f5abb0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be65ea57-bc8d-4bce-80c3-33d8b6007ed1", "name": "network-vif-plugged", "status": "completed", "tag": "d8d91e89-f645-4300-857f-325550442803"}]} {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:00:53.664969 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 05:00:53.664969 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: warnings.warn(msg) Feb 19 05:00:53.685582 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [req-537e4d4a-cf3f-4471-a2c1-1e11b0b9e3d4 req-fb6a6f03-0a8b-4a2e-a04b-5945a3f5abb0 service nova] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:00:53.685961 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [req-537e4d4a-cf3f-4471-a2c1-1e11b0b9e3d4 req-fb6a6f03-0a8b-4a2e-a04b-5945a3f5abb0 service nova] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:00:53.743842 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.compute.server_external_events [req-537e4d4a-cf3f-4471-a2c1-1e11b0b9e3d4 req-fb6a6f03-0a8b-4a2e-a04b-5945a3f5abb0 service nova] Creating event network-vif-plugged:d8d91e89-f645-4300-857f-325550442803 for instance be65ea57-bc8d-4bce-80c3-33d8b6007ed1 on hv-cinder-77642 Feb 19 05:00:53.757682 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [req-537e4d4a-cf3f-4471-a2c1-1e11b0b9e3d4 req-fb6a6f03-0a8b-4a2e-a04b-5945a3f5abb0 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104742 Feb 19 05:00:53.758968 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 76/139] 10.222.0.47 () {64 vars in 1308 bytes} [Fri Feb 19 05:00:53 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 05:00:53.765419 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-5fd903d0-7ab6-44e7-a8a3-7e1636a41128 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:00:53.769254 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-5fd903d0-7ab6-44e7-a8a3-7e1636a41128 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] [instance: 798b77ff-c3ca-4c65-a120-db12ad953621] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:00:53.807158 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-5fd903d0-7ab6-44e7-a8a3-7e1636a41128 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:00:53.807744 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-5fd903d0-7ab6-44e7-a8a3-7e1636a41128 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:00:53.814538 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-5fd903d0-7ab6-44e7-a8a3-7e1636a41128 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:00:53.815050 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-5fd903d0-7ab6-44e7-a8a3-7e1636a41128 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:00:54.230726 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-5fd903d0-7ab6-44e7-a8a3-7e1636a41128 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] 10.222.0.47 "POST /compute/v2.1/servers/798b77ff-c3ca-4c65-a120-db12ad953621/action" status: 200 len: 14 microversion: 2.20 time: 0.468560 Feb 19 05:00:54.232786 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 77/140] 10.222.0.47 () {62 vars in 1309 bytes} [Fri Feb 19 05:00:53 2021] POST /compute/v2.1/servers/798b77ff-c3ca-4c65-a120-db12ad953621/action => generated 14 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:00:54.248108 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [req-a91d97f0-f1bb-457d-a957-36a7f36a6f74 req-b512dd32-86d6-4ab7-a56e-29530d35a71c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "798b77ff-c3ca-4c65-a120-db12ad953621", "tag": "6af5e97b-75ed-4d80-88eb-6ea5c37a0234"}]} {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:00:54.252549 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 05:00:54.252549 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: warnings.warn(msg) Feb 19 05:00:54.280568 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [req-a91d97f0-f1bb-457d-a957-36a7f36a6f74 req-b512dd32-86d6-4ab7-a56e-29530d35a71c service nova] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:00:54.282530 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [req-a91d97f0-f1bb-457d-a957-36a7f36a6f74 req-b512dd32-86d6-4ab7-a56e-29530d35a71c service nova] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:00:54.326209 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.compute.server_external_events [req-a91d97f0-f1bb-457d-a957-36a7f36a6f74 req-b512dd32-86d6-4ab7-a56e-29530d35a71c service nova] Creating event network-changed:6af5e97b-75ed-4d80-88eb-6ea5c37a0234 for instance 798b77ff-c3ca-4c65-a120-db12ad953621 on hv-cinder-77642 Feb 19 05:00:54.337026 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [req-a91d97f0-f1bb-457d-a957-36a7f36a6f74 req-b512dd32-86d6-4ab7-a56e-29530d35a71c service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100802 Feb 19 05:00:54.338505 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 78/141] 10.222.0.47 () {64 vars in 1308 bytes} [Fri Feb 19 05:00:54 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 05:00:54.351159 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-ba9ca60a-134f-4dd8-bc44-4dba2f57a908 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:00:54.352653 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-ba9ca60a-134f-4dd8-bc44-4dba2f57a908 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] [instance: be65ea57-bc8d-4bce-80c3-33d8b6007ed1] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:00:54.373593 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-ba9ca60a-134f-4dd8-bc44-4dba2f57a908 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:00:54.375053 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-ba9ca60a-134f-4dd8-bc44-4dba2f57a908 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:00:54.376996 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-ba9ca60a-134f-4dd8-bc44-4dba2f57a908 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:00:54.378239 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-ba9ca60a-134f-4dd8-bc44-4dba2f57a908 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:00:55.201207 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-1430f093-61a7-4014-a064-36d42f22242d tempest-DeleteServersTestJSON-1855409151 tempest-DeleteServersTestJSON-1855409151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbe79c8c7e046b28563ce75526c5554', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0703bf302bd646109e79f0f89f8938cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:00:55.216251 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-1430f093-61a7-4014-a064-36d42f22242d tempest-DeleteServersTestJSON-1855409151 tempest-DeleteServersTestJSON-1855409151-project] 10.222.0.47 "GET /compute/v2.1/servers/cb93b585-b24f-444e-851a-98f0f13de9b2" status: 200 len: 1554 microversion: 2.1 time: 1.657641 Feb 19 05:00:55.220987 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 64/142] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:00:53 2021] GET /compute/v2.1/servers/cb93b585-b24f-444e-851a-98f0f13de9b2 => generated 1554 bytes in 1663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:00:55.249270 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-81c57a09-4a02-4583-90d2-920b8fa74968 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:00:55.251077 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-81c57a09-4a02-4583-90d2-920b8fa74968 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] [instance: 2182cbf3-8c7a-4e32-937d-baea03567dee] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:00:55.261505 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-81c57a09-4a02-4583-90d2-920b8fa74968 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:00:55.262522 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-81c57a09-4a02-4583-90d2-920b8fa74968 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:00:55.263887 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-81c57a09-4a02-4583-90d2-920b8fa74968 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:00:55.264650 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-81c57a09-4a02-4583-90d2-920b8fa74968 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:00:56.339174 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-81c57a09-4a02-4583-90d2-920b8fa74968 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628d846121a14be78329ccc727c8869d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa473e12960449bbb0713a709e0abe4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:00:56.359921 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-81c57a09-4a02-4583-90d2-920b8fa74968 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] 10.222.0.47 "GET /compute/v2.1/servers/2182cbf3-8c7a-4e32-937d-baea03567dee" status: 200 len: 1317 microversion: 2.1 time: 1.129940 Feb 19 05:00:56.362125 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 65/143] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:00:55 2021] GET /compute/v2.1/servers/2182cbf3-8c7a-4e32-937d-baea03567dee => generated 1317 bytes in 1139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:00:56.376163 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-416527aa-afbc-4768-be12-8ae119d7083e tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:00:56.377796 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-416527aa-afbc-4768-be12-8ae119d7083e tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] [instance: c74e760d-0b53-4508-ae21-494989132c3a] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:00:56.396472 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-416527aa-afbc-4768-be12-8ae119d7083e tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:00:56.397987 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-416527aa-afbc-4768-be12-8ae119d7083e tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:00:56.400362 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-416527aa-afbc-4768-be12-8ae119d7083e tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:00:56.401560 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-416527aa-afbc-4768-be12-8ae119d7083e tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:00:56.475558 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-ba9ca60a-134f-4dd8-bc44-4dba2f57a908 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3274478c0a421895f43618dc827ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50941a0cab243e9a320ff22a7648de6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:00:56.496289 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-ba9ca60a-134f-4dd8-bc44-4dba2f57a908 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] 10.222.0.47 "GET /compute/v2.1/servers/be65ea57-bc8d-4bce-80c3-33d8b6007ed1" status: 200 len: 1360 microversion: 2.1 time: 2.155236 Feb 19 05:00:56.503597 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 79/144] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:00:54 2021] GET /compute/v2.1/servers/be65ea57-bc8d-4bce-80c3-33d8b6007ed1 => generated 1360 bytes in 2165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:00:56.518784 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-531f4c1d-923a-4ef4-822f-27b61a7d83ba tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:00:56.527140 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-531f4c1d-923a-4ef4-822f-27b61a7d83ba tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] [instance: 798b77ff-c3ca-4c65-a120-db12ad953621] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:00:56.553401 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-531f4c1d-923a-4ef4-822f-27b61a7d83ba tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:00:56.563233 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-531f4c1d-923a-4ef4-822f-27b61a7d83ba tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:00:56.565203 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-531f4c1d-923a-4ef4-822f-27b61a7d83ba tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:00:56.565735 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-531f4c1d-923a-4ef4-822f-27b61a7d83ba tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:00:56.831359 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-531f4c1d-923a-4ef4-822f-27b61a7d83ba tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] 10.222.0.47 "POST /compute/v2.1/servers/798b77ff-c3ca-4c65-a120-db12ad953621/action" status: 200 len: 14 microversion: 2.20 time: 0.323992 Feb 19 05:00:56.833974 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 80/145] 10.222.0.47 () {62 vars in 1309 bytes} [Fri Feb 19 05:00:56 2021] POST /compute/v2.1/servers/798b77ff-c3ca-4c65-a120-db12ad953621/action => generated 14 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:00:56.845513 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-e2e53ffa-3539-465b-8b15-ea2af66c0e56 tempest-DeleteServersTestJSON-1855409151 tempest-DeleteServersTestJSON-1855409151-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:00:56.846985 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-e2e53ffa-3539-465b-8b15-ea2af66c0e56 tempest-DeleteServersTestJSON-1855409151 tempest-DeleteServersTestJSON-1855409151-project] [instance: cb93b585-b24f-444e-851a-98f0f13de9b2] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:00:56.863033 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-e2e53ffa-3539-465b-8b15-ea2af66c0e56 tempest-DeleteServersTestJSON-1855409151 tempest-DeleteServersTestJSON-1855409151-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:00:56.863680 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-e2e53ffa-3539-465b-8b15-ea2af66c0e56 tempest-DeleteServersTestJSON-1855409151 tempest-DeleteServersTestJSON-1855409151-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:00:56.865220 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-e2e53ffa-3539-465b-8b15-ea2af66c0e56 tempest-DeleteServersTestJSON-1855409151 tempest-DeleteServersTestJSON-1855409151-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:00:56.866215 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-e2e53ffa-3539-465b-8b15-ea2af66c0e56 tempest-DeleteServersTestJSON-1855409151 tempest-DeleteServersTestJSON-1855409151-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:00:57.731401 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-416527aa-afbc-4768-be12-8ae119d7083e tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24af0562e2aa43ca9d601be5e16fe9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ee9a43087d5497da3af9fbf68c4572d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:00:57.744658 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-416527aa-afbc-4768-be12-8ae119d7083e tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] 10.222.0.47 "GET /compute/v2.1/servers/c74e760d-0b53-4508-ae21-494989132c3a" status: 200 len: 1521 microversion: 2.1 time: 1.380403 Feb 19 05:00:57.745518 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 66/146] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:00:56 2021] GET /compute/v2.1/servers/c74e760d-0b53-4508-ae21-494989132c3a => generated 1521 bytes in 1383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:00:57.762890 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [req-12ba81a9-3b04-446c-9f97-e9a64a4d50bb req-b7af7619-a806-480b-934f-f0ee02887085 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb93b585-b24f-444e-851a-98f0f13de9b2", "name": "network-vif-unplugged", "status": "completed", "tag": "42106eef-d038-443f-9ab2-92e08bef76ec"}]} {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:00:57.767279 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 05:00:57.767279 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: warnings.warn(msg) Feb 19 05:00:57.785498 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [req-12ba81a9-3b04-446c-9f97-e9a64a4d50bb req-b7af7619-a806-480b-934f-f0ee02887085 service nova] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:00:57.787006 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [req-12ba81a9-3b04-446c-9f97-e9a64a4d50bb req-b7af7619-a806-480b-934f-f0ee02887085 service nova] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:00:57.826227 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.compute.server_external_events [req-12ba81a9-3b04-446c-9f97-e9a64a4d50bb req-b7af7619-a806-480b-934f-f0ee02887085 service nova] Creating event network-vif-unplugged:42106eef-d038-443f-9ab2-92e08bef76ec for instance cb93b585-b24f-444e-851a-98f0f13de9b2 on hv-cinder-77642 Feb 19 05:00:57.838496 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [req-12ba81a9-3b04-446c-9f97-e9a64a4d50bb req-b7af7619-a806-480b-934f-f0ee02887085 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.086337 Feb 19 05:00:57.838496 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 67/147] 10.222.0.47 () {64 vars in 1308 bytes} [Fri Feb 19 05:00:57 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 05:00:57.847226 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-fa0caedb-7ec8-4553-86e3-04de46e26b40 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:00:57.848050 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-fa0caedb-7ec8-4553-86e3-04de46e26b40 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] [instance: 2182cbf3-8c7a-4e32-937d-baea03567dee] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:00:57.859007 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-fa0caedb-7ec8-4553-86e3-04de46e26b40 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:00:57.859007 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-fa0caedb-7ec8-4553-86e3-04de46e26b40 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:00:57.860178 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-fa0caedb-7ec8-4553-86e3-04de46e26b40 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:00:57.860729 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-fa0caedb-7ec8-4553-86e3-04de46e26b40 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:00:57.947921 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-e2e53ffa-3539-465b-8b15-ea2af66c0e56 tempest-DeleteServersTestJSON-1855409151 tempest-DeleteServersTestJSON-1855409151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbe79c8c7e046b28563ce75526c5554', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0703bf302bd646109e79f0f89f8938cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:00:58.010831 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-e2e53ffa-3539-465b-8b15-ea2af66c0e56 tempest-DeleteServersTestJSON-1855409151 tempest-DeleteServersTestJSON-1855409151-project] 10.222.0.47 "GET /compute/v2.1/servers/cb93b585-b24f-444e-851a-98f0f13de9b2" status: 200 len: 1554 microversion: 2.1 time: 1.175110 Feb 19 05:00:58.011838 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 81/148] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:00:56 2021] GET /compute/v2.1/servers/cb93b585-b24f-444e-851a-98f0f13de9b2 => generated 1554 bytes in 1178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:00:58.017033 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-f6aa7ec4-5554-4400-8d26-c6155e595348 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:00:58.017697 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-f6aa7ec4-5554-4400-8d26-c6155e595348 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] [instance: be65ea57-bc8d-4bce-80c3-33d8b6007ed1] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:00:58.026326 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-f6aa7ec4-5554-4400-8d26-c6155e595348 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:00:58.027388 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-f6aa7ec4-5554-4400-8d26-c6155e595348 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:00:58.027850 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-f6aa7ec4-5554-4400-8d26-c6155e595348 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:00:58.028395 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-f6aa7ec4-5554-4400-8d26-c6155e595348 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:00:59.506151 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-fa0caedb-7ec8-4553-86e3-04de46e26b40 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628d846121a14be78329ccc727c8869d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa473e12960449bbb0713a709e0abe4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:00:59.523017 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-fa0caedb-7ec8-4553-86e3-04de46e26b40 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] 10.222.0.47 "GET /compute/v2.1/servers/2182cbf3-8c7a-4e32-937d-baea03567dee" status: 200 len: 1317 microversion: 2.1 time: 1.681497 Feb 19 05:00:59.534012 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-f6aa7ec4-5554-4400-8d26-c6155e595348 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3274478c0a421895f43618dc827ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50941a0cab243e9a320ff22a7648de6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:00:59.534992 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 68/149] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:00:57 2021] GET /compute/v2.1/servers/2182cbf3-8c7a-4e32-937d-baea03567dee => generated 1317 bytes in 1694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:00:59.567670 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-5965b6e1-32b0-411d-8ebe-2c4296c108c0 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:00:59.572548 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-5965b6e1-32b0-411d-8ebe-2c4296c108c0 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] [instance: 798b77ff-c3ca-4c65-a120-db12ad953621] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:00:59.588595 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-f6aa7ec4-5554-4400-8d26-c6155e595348 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] 10.222.0.47 "GET /compute/v2.1/servers/be65ea57-bc8d-4bce-80c3-33d8b6007ed1" status: 200 len: 1547 microversion: 2.1 time: 1.574742 Feb 19 05:00:59.591997 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-5965b6e1-32b0-411d-8ebe-2c4296c108c0 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:00:59.592717 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-5965b6e1-32b0-411d-8ebe-2c4296c108c0 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:00:59.594080 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-5965b6e1-32b0-411d-8ebe-2c4296c108c0 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:00:59.594736 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-5965b6e1-32b0-411d-8ebe-2c4296c108c0 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:00:59.607210 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 82/150] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:00:58 2021] GET /compute/v2.1/servers/be65ea57-bc8d-4bce-80c3-33d8b6007ed1 => generated 1547 bytes in 1594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:00:59.665016 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [req-c4504ada-b3d7-4f35-b3e3-3f115662a239 req-82bfd700-61f3-4b93-8ae9-e52d9e4e8207 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2182cbf3-8c7a-4e32-937d-baea03567dee", "tag": "76750292-0f7c-4d68-a19b-7aaba2d4f5a7"}]} {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:00:59.679501 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 05:00:59.679501 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: warnings.warn(msg) Feb 19 05:00:59.737795 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [req-c4504ada-b3d7-4f35-b3e3-3f115662a239 req-82bfd700-61f3-4b93-8ae9-e52d9e4e8207 service nova] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:00:59.739127 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [req-c4504ada-b3d7-4f35-b3e3-3f115662a239 req-82bfd700-61f3-4b93-8ae9-e52d9e4e8207 service nova] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:00:59.783592 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-5965b6e1-32b0-411d-8ebe-2c4296c108c0 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] 10.222.0.47 "POST /compute/v2.1/servers/798b77ff-c3ca-4c65-a120-db12ad953621/action" status: 200 len: 14 microversion: 2.20 time: 0.245776 Feb 19 05:00:59.784555 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 69/151] 10.222.0.47 () {62 vars in 1309 bytes} [Fri Feb 19 05:00:59 2021] POST /compute/v2.1/servers/798b77ff-c3ca-4c65-a120-db12ad953621/action => generated 14 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:00:59.795443 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-49f4bbfd-a810-464f-adc9-b0cc37fd6301 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:00:59.796451 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-49f4bbfd-a810-464f-adc9-b0cc37fd6301 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] [instance: c74e760d-0b53-4508-ae21-494989132c3a] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:00:59.817622 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-49f4bbfd-a810-464f-adc9-b0cc37fd6301 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:00:59.822698 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-49f4bbfd-a810-464f-adc9-b0cc37fd6301 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:00:59.823952 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-49f4bbfd-a810-464f-adc9-b0cc37fd6301 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:00:59.825483 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-49f4bbfd-a810-464f-adc9-b0cc37fd6301 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:00:59.844696 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.compute.server_external_events [req-c4504ada-b3d7-4f35-b3e3-3f115662a239 req-82bfd700-61f3-4b93-8ae9-e52d9e4e8207 service nova] Creating event network-changed:76750292-0f7c-4d68-a19b-7aaba2d4f5a7 for instance 2182cbf3-8c7a-4e32-937d-baea03567dee on hv-cinder-77642 Feb 19 05:00:59.868454 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [req-c4504ada-b3d7-4f35-b3e3-3f115662a239 req-82bfd700-61f3-4b93-8ae9-e52d9e4e8207 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.258505 Feb 19 05:00:59.872953 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 83/152] 10.222.0.47 () {64 vars in 1308 bytes} [Fri Feb 19 05:00:59 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 05:00:59.903914 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-9d0313b2-0549-433d-bc3a-dc2a6edf74dc tempest-DeleteServersTestJSON-1855409151 tempest-DeleteServersTestJSON-1855409151-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:00:59.908867 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-9d0313b2-0549-433d-bc3a-dc2a6edf74dc tempest-DeleteServersTestJSON-1855409151 tempest-DeleteServersTestJSON-1855409151-project] [instance: cb93b585-b24f-444e-851a-98f0f13de9b2] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:00:59.977186 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-9d0313b2-0549-433d-bc3a-dc2a6edf74dc tempest-DeleteServersTestJSON-1855409151 tempest-DeleteServersTestJSON-1855409151-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:00:59.983707 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-9d0313b2-0549-433d-bc3a-dc2a6edf74dc tempest-DeleteServersTestJSON-1855409151 tempest-DeleteServersTestJSON-1855409151-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:00:59.985330 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-9d0313b2-0549-433d-bc3a-dc2a6edf74dc tempest-DeleteServersTestJSON-1855409151 tempest-DeleteServersTestJSON-1855409151-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:00:59.986278 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-9d0313b2-0549-433d-bc3a-dc2a6edf74dc tempest-DeleteServersTestJSON-1855409151 tempest-DeleteServersTestJSON-1855409151-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:00.237651 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-9d0313b2-0549-433d-bc3a-dc2a6edf74dc tempest-DeleteServersTestJSON-1855409151 tempest-DeleteServersTestJSON-1855409151-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:00.241149 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-9d0313b2-0549-433d-bc3a-dc2a6edf74dc tempest-DeleteServersTestJSON-1855409151 tempest-DeleteServersTestJSON-1855409151-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:00.242547 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.objects.instance [None req-9d0313b2-0549-433d-bc3a-dc2a6edf74dc tempest-DeleteServersTestJSON-1855409151 tempest-DeleteServersTestJSON-1855409151-project] Lazy-loading 'fault' on Instance uuid cb93b585-b24f-444e-851a-98f0f13de9b2 {{(pid=98154) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Feb 19 05:01:00.483554 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-9d0313b2-0549-433d-bc3a-dc2a6edf74dc tempest-DeleteServersTestJSON-1855409151 tempest-DeleteServersTestJSON-1855409151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbe79c8c7e046b28563ce75526c5554', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0703bf302bd646109e79f0f89f8938cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:01:00.570277 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-9d0313b2-0549-433d-bc3a-dc2a6edf74dc tempest-DeleteServersTestJSON-1855409151 tempest-DeleteServersTestJSON-1855409151-project] 10.222.0.47 "GET /compute/v2.1/servers/cb93b585-b24f-444e-851a-98f0f13de9b2" status: 200 len: 1351 microversion: 2.1 time: 0.688565 Feb 19 05:01:00.576311 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 84/153] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:00:59 2021] GET /compute/v2.1/servers/cb93b585-b24f-444e-851a-98f0f13de9b2 => generated 1351 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:01:00.600292 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-86c15b9a-7bf9-4df7-b356-b6a5a53c79bf tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:01:00.600570 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-49f4bbfd-a810-464f-adc9-b0cc37fd6301 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24af0562e2aa43ca9d601be5e16fe9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ee9a43087d5497da3af9fbf68c4572d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:01:00.601740 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-86c15b9a-7bf9-4df7-b356-b6a5a53c79bf tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] [instance: be65ea57-bc8d-4bce-80c3-33d8b6007ed1] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:01:00.623460 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-86c15b9a-7bf9-4df7-b356-b6a5a53c79bf tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:00.624904 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-86c15b9a-7bf9-4df7-b356-b6a5a53c79bf tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:00.632036 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-86c15b9a-7bf9-4df7-b356-b6a5a53c79bf tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:00.633262 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-86c15b9a-7bf9-4df7-b356-b6a5a53c79bf tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:00.652719 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-49f4bbfd-a810-464f-adc9-b0cc37fd6301 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] 10.222.0.47 "GET /compute/v2.1/servers/c74e760d-0b53-4508-ae21-494989132c3a" status: 200 len: 1521 microversion: 2.1 time: 0.865486 Feb 19 05:01:00.656050 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 70/154] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:00:59 2021] GET /compute/v2.1/servers/c74e760d-0b53-4508-ae21-494989132c3a => generated 1521 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:01:00.682085 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-7214a417-d85d-4fcf-9b90-692d06a6a0bf tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:01:00.683711 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-7214a417-d85d-4fcf-9b90-692d06a6a0bf tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] [instance: 2182cbf3-8c7a-4e32-937d-baea03567dee] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:01:00.747685 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-7214a417-d85d-4fcf-9b90-692d06a6a0bf tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:00.748627 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-7214a417-d85d-4fcf-9b90-692d06a6a0bf tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:00.750421 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-7214a417-d85d-4fcf-9b90-692d06a6a0bf tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:00.751377 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-7214a417-d85d-4fcf-9b90-692d06a6a0bf tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:01.313140 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-86c15b9a-7bf9-4df7-b356-b6a5a53c79bf tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] 10.222.0.47 "GET /compute/v2.1/servers/be65ea57-bc8d-4bce-80c3-33d8b6007ed1/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.734268 Feb 19 05:01:01.314497 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 85/155] 10.222.0.47 () {58 vars in 1265 bytes} [Fri Feb 19 05:01:00 2021] GET /compute/v2.1/servers/be65ea57-bc8d-4bce-80c3-33d8b6007ed1/os-interface => generated 285 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 05:01:01.332467 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-d2357071-a7f4-4c2b-9799-e7afca25ce6e tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:01:01.334636 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-d2357071-a7f4-4c2b-9799-e7afca25ce6e tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] [instance: 798b77ff-c3ca-4c65-a120-db12ad953621] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:01:01.372214 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-d2357071-a7f4-4c2b-9799-e7afca25ce6e tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:01.373219 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-d2357071-a7f4-4c2b-9799-e7afca25ce6e tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:01.374896 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-d2357071-a7f4-4c2b-9799-e7afca25ce6e tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:01.375785 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-d2357071-a7f4-4c2b-9799-e7afca25ce6e tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:01.761982 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-d2357071-a7f4-4c2b-9799-e7afca25ce6e tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] 10.222.0.47 "POST /compute/v2.1/servers/798b77ff-c3ca-4c65-a120-db12ad953621/action" status: 200 len: 14 microversion: 2.20 time: 0.444892 Feb 19 05:01:01.767390 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 86/156] 10.222.0.47 () {62 vars in 1309 bytes} [Fri Feb 19 05:01:01 2021] POST /compute/v2.1/servers/798b77ff-c3ca-4c65-a120-db12ad953621/action => generated 14 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:01:01.790205 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-6f0a4ce2-895e-4c21-9fc5-5ecbe4cf388b tempest-DeleteServersTestJSON-1855409151 tempest-DeleteServersTestJSON-1855409151-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:01:01.796897 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-6f0a4ce2-895e-4c21-9fc5-5ecbe4cf388b tempest-DeleteServersTestJSON-1855409151 tempest-DeleteServersTestJSON-1855409151-project] [instance: cb93b585-b24f-444e-851a-98f0f13de9b2] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:01:01.820324 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-6f0a4ce2-895e-4c21-9fc5-5ecbe4cf388b tempest-DeleteServersTestJSON-1855409151 tempest-DeleteServersTestJSON-1855409151-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:01.821564 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-6f0a4ce2-895e-4c21-9fc5-5ecbe4cf388b tempest-DeleteServersTestJSON-1855409151 tempest-DeleteServersTestJSON-1855409151-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:01.823551 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-6f0a4ce2-895e-4c21-9fc5-5ecbe4cf388b tempest-DeleteServersTestJSON-1855409151 tempest-DeleteServersTestJSON-1855409151-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:01.824682 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-6f0a4ce2-895e-4c21-9fc5-5ecbe4cf388b tempest-DeleteServersTestJSON-1855409151 tempest-DeleteServersTestJSON-1855409151-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:01.925219 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-7214a417-d85d-4fcf-9b90-692d06a6a0bf tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628d846121a14be78329ccc727c8869d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa473e12960449bbb0713a709e0abe4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:01:01.979320 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-7214a417-d85d-4fcf-9b90-692d06a6a0bf tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] 10.222.0.47 "GET /compute/v2.1/servers/2182cbf3-8c7a-4e32-937d-baea03567dee" status: 200 len: 1317 microversion: 2.1 time: 1.310730 Feb 19 05:01:01.980992 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 71/157] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:01:00 2021] GET /compute/v2.1/servers/2182cbf3-8c7a-4e32-937d-baea03567dee => generated 1317 bytes in 1322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:01:01.989400 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.wsgi [None req-6f0a4ce2-895e-4c21-9fc5-5ecbe4cf388b tempest-DeleteServersTestJSON-1855409151 tempest-DeleteServersTestJSON-1855409151-project] HTTP exception thrown: Instance cb93b585-b24f-444e-851a-98f0f13de9b2 could not be found. Feb 19 05:01:01.990634 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-6f0a4ce2-895e-4c21-9fc5-5ecbe4cf388b tempest-DeleteServersTestJSON-1855409151 tempest-DeleteServersTestJSON-1855409151-project] Returning 404 to user: Instance cb93b585-b24f-444e-851a-98f0f13de9b2 could not be found. {{(pid=98154) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 19 05:01:01.994296 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-6f0a4ce2-895e-4c21-9fc5-5ecbe4cf388b tempest-DeleteServersTestJSON-1855409151 tempest-DeleteServersTestJSON-1855409151-project] 10.222.0.47 "GET /compute/v2.1/servers/cb93b585-b24f-444e-851a-98f0f13de9b2" status: 404 len: 111 microversion: 2.1 time: 0.221955 Feb 19 05:01:01.996982 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 87/158] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:01:01 2021] GET /compute/v2.1/servers/cb93b585-b24f-444e-851a-98f0f13de9b2 => generated 111 bytes in 228 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 05:01:02.002605 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-450ced5d-bac9-42e8-943b-068aedda3ba0 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:01:02.003803 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-450ced5d-bac9-42e8-943b-068aedda3ba0 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] [instance: c74e760d-0b53-4508-ae21-494989132c3a] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:01:02.015748 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [req-e7bb0ed5-5c30-4daf-824a-298d3fb074db req-ce8828d4-6391-4a90-a828-fba1d799f271 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb93b585-b24f-444e-851a-98f0f13de9b2", "name": "network-vif-deleted", "tag": "42106eef-d038-443f-9ab2-92e08bef76ec"}]} {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:01:02.026349 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 05:01:02.026349 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: warnings.warn(msg) Feb 19 05:01:02.046356 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-450ced5d-bac9-42e8-943b-068aedda3ba0 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:02.047456 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-450ced5d-bac9-42e8-943b-068aedda3ba0 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:02.049262 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-450ced5d-bac9-42e8-943b-068aedda3ba0 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:02.052394 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-450ced5d-bac9-42e8-943b-068aedda3ba0 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:02.073659 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [req-e7bb0ed5-5c30-4daf-824a-298d3fb074db req-ce8828d4-6391-4a90-a828-fba1d799f271 service nova] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:02.074511 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [req-e7bb0ed5-5c30-4daf-824a-298d3fb074db req-ce8828d4-6391-4a90-a828-fba1d799f271 service nova] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:02.211786 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.compute.server_external_events [req-e7bb0ed5-5c30-4daf-824a-298d3fb074db req-ce8828d4-6391-4a90-a828-fba1d799f271 service nova] Creating event network-vif-deleted:42106eef-d038-443f-9ab2-92e08bef76ec for instance cb93b585-b24f-444e-851a-98f0f13de9b2 on hv-cinder-77642 Feb 19 05:01:02.249873 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [req-e7bb0ed5-5c30-4daf-824a-298d3fb074db req-ce8828d4-6391-4a90-a828-fba1d799f271 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.249625 Feb 19 05:01:02.251455 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 88/159] 10.222.0.47 () {64 vars in 1308 bytes} [Fri Feb 19 05:01:01 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 05:01:02.778519 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-8fc58143-01f8-49d2-b6ad-4c5f91f56703 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:01:02.779862 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-8fc58143-01f8-49d2-b6ad-4c5f91f56703 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] [instance: 798b77ff-c3ca-4c65-a120-db12ad953621] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:01:02.790688 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-8fc58143-01f8-49d2-b6ad-4c5f91f56703 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:02.791520 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-8fc58143-01f8-49d2-b6ad-4c5f91f56703 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:02.792537 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-8fc58143-01f8-49d2-b6ad-4c5f91f56703 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:02.793178 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-8fc58143-01f8-49d2-b6ad-4c5f91f56703 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:03.063586 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-8fc58143-01f8-49d2-b6ad-4c5f91f56703 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] 10.222.0.47 "POST /compute/v2.1/servers/798b77ff-c3ca-4c65-a120-db12ad953621/action" status: 200 len: 198 microversion: 2.20 time: 0.290468 Feb 19 05:01:03.078829 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 89/160] 10.222.0.47 () {62 vars in 1309 bytes} [Fri Feb 19 05:01:02 2021] POST /compute/v2.1/servers/798b77ff-c3ca-4c65-a120-db12ad953621/action => generated 198 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 19 05:01:03.099058 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-9e5c5bad-91f9-40d5-84d8-8fed2d48bc6d tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:01:03.103427 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-9e5c5bad-91f9-40d5-84d8-8fed2d48bc6d tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] [instance: 2182cbf3-8c7a-4e32-937d-baea03567dee] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:01:03.126309 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-9e5c5bad-91f9-40d5-84d8-8fed2d48bc6d tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:03.126756 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-9e5c5bad-91f9-40d5-84d8-8fed2d48bc6d tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:03.127714 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-9e5c5bad-91f9-40d5-84d8-8fed2d48bc6d tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:03.128225 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-9e5c5bad-91f9-40d5-84d8-8fed2d48bc6d tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:03.502296 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-450ced5d-bac9-42e8-943b-068aedda3ba0 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24af0562e2aa43ca9d601be5e16fe9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ee9a43087d5497da3af9fbf68c4572d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:01:03.520952 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-450ced5d-bac9-42e8-943b-068aedda3ba0 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] 10.222.0.47 "GET /compute/v2.1/servers/c74e760d-0b53-4508-ae21-494989132c3a" status: 200 len: 1521 microversion: 2.1 time: 1.536768 Feb 19 05:01:03.521511 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 72/161] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:01:01 2021] GET /compute/v2.1/servers/c74e760d-0b53-4508-ae21-494989132c3a => generated 1521 bytes in 1540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:01:03.531709 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-1d10f6e7-63d2-494a-bed0-5a7c2d802c34 tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-2120325807", "imageRef": "53cdf9de-e495-4ca8-845f-6be2bf32cecb", "flavorRef": "452", "networks": [{"uuid": "c5268f31-5887-4751-b292-351f008461dc"}]}} {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:01:03.675733 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.network.neutron [None req-1d10f6e7-63d2-494a-bed0-5a7c2d802c34 tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] validate_networks() for [('c5268f31-5887-4751-b292-351f008461dc', None, None, None)] {{(pid=98153) validate_networks /opt/stack/nova/nova/network/neutron.py:2345}} Feb 19 05:01:04.062403 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-9e5c5bad-91f9-40d5-84d8-8fed2d48bc6d tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628d846121a14be78329ccc727c8869d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa473e12960449bbb0713a709e0abe4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:01:04.072790 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-9e5c5bad-91f9-40d5-84d8-8fed2d48bc6d tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] 10.222.0.47 "GET /compute/v2.1/servers/2182cbf3-8c7a-4e32-937d-baea03567dee" status: 200 len: 1317 microversion: 2.1 time: 0.994710 Feb 19 05:01:04.073437 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 90/162] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:01:03 2021] GET /compute/v2.1/servers/2182cbf3-8c7a-4e32-937d-baea03567dee => generated 1317 bytes in 996 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:01:04.089357 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [req-f01748aa-7b97-4cd6-9ce9-e488ba5c1587 req-d7352f7f-4984-4b17-8ded-0efa85f37da8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2182cbf3-8c7a-4e32-937d-baea03567dee", "name": "network-vif-plugged", "status": "completed", "tag": "76750292-0f7c-4d68-a19b-7aaba2d4f5a7"}]} {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:01:04.091145 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 05:01:04.091145 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: warnings.warn(msg) Feb 19 05:01:04.112320 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [req-f01748aa-7b97-4cd6-9ce9-e488ba5c1587 req-d7352f7f-4984-4b17-8ded-0efa85f37da8 service nova] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:04.112832 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [req-f01748aa-7b97-4cd6-9ce9-e488ba5c1587 req-d7352f7f-4984-4b17-8ded-0efa85f37da8 service nova] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:04.132514 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.compute.server_external_events [req-f01748aa-7b97-4cd6-9ce9-e488ba5c1587 req-d7352f7f-4984-4b17-8ded-0efa85f37da8 service nova] Creating event network-vif-plugged:76750292-0f7c-4d68-a19b-7aaba2d4f5a7 for instance 2182cbf3-8c7a-4e32-937d-baea03567dee on hv-cinder-77642 Feb 19 05:01:04.138594 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [req-f01748aa-7b97-4cd6-9ce9-e488ba5c1587 req-d7352f7f-4984-4b17-8ded-0efa85f37da8 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057106 Feb 19 05:01:04.139801 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 91/163] 10.222.0.47 () {64 vars in 1308 bytes} [Fri Feb 19 05:01:04 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 05:01:04.146289 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-2ad23f19-c0cb-4fda-8bf7-b74481475923 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:01:04.147763 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-2ad23f19-c0cb-4fda-8bf7-b74481475923 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] [instance: 798b77ff-c3ca-4c65-a120-db12ad953621] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:01:04.156483 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-2ad23f19-c0cb-4fda-8bf7-b74481475923 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:04.157357 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-2ad23f19-c0cb-4fda-8bf7-b74481475923 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:04.158465 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-2ad23f19-c0cb-4fda-8bf7-b74481475923 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:04.159161 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-2ad23f19-c0cb-4fda-8bf7-b74481475923 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:04.355868 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-2ad23f19-c0cb-4fda-8bf7-b74481475923 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] 10.222.0.47 "POST /compute/v2.1/servers/798b77ff-c3ca-4c65-a120-db12ad953621/action" status: 200 len: 11050 microversion: 2.20 time: 0.214291 Feb 19 05:01:04.356784 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 92/164] 10.222.0.47 () {62 vars in 1309 bytes} [Fri Feb 19 05:01:04 2021] POST /compute/v2.1/servers/798b77ff-c3ca-4c65-a120-db12ad953621/action => generated 11050 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 19 05:01:04.366244 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-2725abdb-5e53-4c32-bc65-628b991aec0b tempest-DeleteServersTestJSON-1855409151 tempest-DeleteServersTestJSON-1855409151-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:01:04.366877 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-2725abdb-5e53-4c32-bc65-628b991aec0b tempest-DeleteServersTestJSON-1855409151 tempest-DeleteServersTestJSON-1855409151-project] [instance: cb93b585-b24f-444e-851a-98f0f13de9b2] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:01:04.389495 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-2725abdb-5e53-4c32-bc65-628b991aec0b tempest-DeleteServersTestJSON-1855409151 tempest-DeleteServersTestJSON-1855409151-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:04.393426 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-2725abdb-5e53-4c32-bc65-628b991aec0b tempest-DeleteServersTestJSON-1855409151 tempest-DeleteServersTestJSON-1855409151-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:04.396401 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-2725abdb-5e53-4c32-bc65-628b991aec0b tempest-DeleteServersTestJSON-1855409151 tempest-DeleteServersTestJSON-1855409151-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:04.397112 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-2725abdb-5e53-4c32-bc65-628b991aec0b tempest-DeleteServersTestJSON-1855409151 tempest-DeleteServersTestJSON-1855409151-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:04.498782 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.wsgi [None req-2725abdb-5e53-4c32-bc65-628b991aec0b tempest-DeleteServersTestJSON-1855409151 tempest-DeleteServersTestJSON-1855409151-project] HTTP exception thrown: Instance cb93b585-b24f-444e-851a-98f0f13de9b2 could not be found. Feb 19 05:01:04.500416 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-2725abdb-5e53-4c32-bc65-628b991aec0b tempest-DeleteServersTestJSON-1855409151 tempest-DeleteServersTestJSON-1855409151-project] Returning 404 to user: Instance cb93b585-b24f-444e-851a-98f0f13de9b2 could not be found. {{(pid=98154) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 19 05:01:04.501542 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-2725abdb-5e53-4c32-bc65-628b991aec0b tempest-DeleteServersTestJSON-1855409151 tempest-DeleteServersTestJSON-1855409151-project] 10.222.0.47 "DELETE /compute/v2.1/servers/cb93b585-b24f-444e-851a-98f0f13de9b2" status: 404 len: 111 microversion: 2.1 time: 0.143397 Feb 19 05:01:04.502393 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 93/165] 10.222.0.47 () {58 vars in 1229 bytes} [Fri Feb 19 05:01:04 2021] DELETE /compute/v2.1/servers/cb93b585-b24f-444e-851a-98f0f13de9b2 => generated 111 bytes in 145 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 05:01:04.513762 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-1046a0e6-0272-40c7-81b2-333f1787ecf5 tempest-DeleteServersTestJSON-1855409151 tempest-DeleteServersTestJSON-1855409151-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:01:04.514859 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-1046a0e6-0272-40c7-81b2-333f1787ecf5 tempest-DeleteServersTestJSON-1855409151 tempest-DeleteServersTestJSON-1855409151-project] [instance: cb93b585-b24f-444e-851a-98f0f13de9b2] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:01:04.525499 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-1046a0e6-0272-40c7-81b2-333f1787ecf5 tempest-DeleteServersTestJSON-1855409151 tempest-DeleteServersTestJSON-1855409151-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:04.526240 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-1046a0e6-0272-40c7-81b2-333f1787ecf5 tempest-DeleteServersTestJSON-1855409151 tempest-DeleteServersTestJSON-1855409151-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:04.527348 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-1046a0e6-0272-40c7-81b2-333f1787ecf5 tempest-DeleteServersTestJSON-1855409151 tempest-DeleteServersTestJSON-1855409151-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:04.528052 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-1046a0e6-0272-40c7-81b2-333f1787ecf5 tempest-DeleteServersTestJSON-1855409151 tempest-DeleteServersTestJSON-1855409151-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:04.588475 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.wsgi [None req-1046a0e6-0272-40c7-81b2-333f1787ecf5 tempest-DeleteServersTestJSON-1855409151 tempest-DeleteServersTestJSON-1855409151-project] HTTP exception thrown: Instance cb93b585-b24f-444e-851a-98f0f13de9b2 could not be found. Feb 19 05:01:04.589327 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-1046a0e6-0272-40c7-81b2-333f1787ecf5 tempest-DeleteServersTestJSON-1855409151 tempest-DeleteServersTestJSON-1855409151-project] Returning 404 to user: Instance cb93b585-b24f-444e-851a-98f0f13de9b2 could not be found. {{(pid=98154) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 19 05:01:04.590607 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-1046a0e6-0272-40c7-81b2-333f1787ecf5 tempest-DeleteServersTestJSON-1855409151 tempest-DeleteServersTestJSON-1855409151-project] 10.222.0.47 "GET /compute/v2.1/servers/cb93b585-b24f-444e-851a-98f0f13de9b2" status: 404 len: 111 microversion: 2.1 time: 0.081569 Feb 19 05:01:04.591631 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 94/166] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:01:04 2021] GET /compute/v2.1/servers/cb93b585-b24f-444e-851a-98f0f13de9b2 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Feb 19 05:01:04.601356 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-d5f55932-79ce-4b38-9cb7-86347e75ed30 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:01:04.602394 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-d5f55932-79ce-4b38-9cb7-86347e75ed30 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] [instance: c74e760d-0b53-4508-ae21-494989132c3a] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:01:04.614339 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-d5f55932-79ce-4b38-9cb7-86347e75ed30 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:04.615362 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-d5f55932-79ce-4b38-9cb7-86347e75ed30 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:04.617043 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-d5f55932-79ce-4b38-9cb7-86347e75ed30 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:04.617856 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-d5f55932-79ce-4b38-9cb7-86347e75ed30 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:05.468673 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.virt.hardware [None req-1d10f6e7-63d2-494a-bed0-5a7c2d802c34 tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Flavor limits 0:0:0 {{(pid=98153) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 19 05:01:05.469438 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.virt.hardware [None req-1d10f6e7-63d2-494a-bed0-5a7c2d802c34 tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Image limits 0:0:0 {{(pid=98153) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Feb 19 05:01:05.469630 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.virt.hardware [None req-1d10f6e7-63d2-494a-bed0-5a7c2d802c34 tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Flavor pref 0:0:0 {{(pid=98153) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 19 05:01:05.470243 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.virt.hardware [None req-1d10f6e7-63d2-494a-bed0-5a7c2d802c34 tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Image pref 0:0:0 {{(pid=98153) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Feb 19 05:01:05.471169 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.virt.hardware [None req-1d10f6e7-63d2-494a-bed0-5a7c2d802c34 tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98153) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Feb 19 05:01:05.495234 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-1d10f6e7-63d2-494a-bed0-5a7c2d802c34 tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:05.496149 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-1d10f6e7-63d2-494a-bed0-5a7c2d802c34 tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:05.498539 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-1d10f6e7-63d2-494a-bed0-5a7c2d802c34 tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:05.500035 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-1d10f6e7-63d2-494a-bed0-5a7c2d802c34 tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:05.550071 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.quota [None req-1d10f6e7-63d2-494a-bed0-5a7c2d802c34 tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Getting quotas for project 1f6827c056bf4dc0b68a527187f4be9e. Resources: {'instances', 'ram', 'cores'} {{(pid=98153) _get_quotas /opt/stack/nova/nova/quota.py:388}} Feb 19 05:01:05.568124 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.quota [None req-1d10f6e7-63d2-494a-bed0-5a7c2d802c34 tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Getting quotas for user 50ac58c346fa4d569782f22a3394e22a and project 1f6827c056bf4dc0b68a527187f4be9e. Resources: {'instances', 'ram', 'cores'} {{(pid=98153) _get_quotas /opt/stack/nova/nova/quota.py:380}} Feb 19 05:01:05.594165 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-1d10f6e7-63d2-494a-bed0-5a7c2d802c34 tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Going to run 1 instances... {{(pid=98153) _provision_instances /opt/stack/nova/nova/compute/api.py:1264}} Feb 19 05:01:05.598110 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-1d10f6e7-63d2-494a-bed0-5a7c2d802c34 tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] [instance: 65b5a76b-3d64-4b51-b955-04f6bdc76253] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='53cdf9de-e495-4ca8-845f-6be2bf32cecb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98153) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1666}} Feb 19 05:01:05.725514 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-1d10f6e7-63d2-494a-bed0-5a7c2d802c34 tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.202236 Feb 19 05:01:05.730552 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 73/167] 10.222.0.47 () {60 vars in 1137 bytes} [Fri Feb 19 05:01:03 2021] POST /compute/v2.1/servers => generated 380 bytes in 2208 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 19 05:01:05.743766 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-b4e19379-2213-4b74-94a2-b6fb8032f95a tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:01:05.756053 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-b4e19379-2213-4b74-94a2-b6fb8032f95a tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] [instance: 2182cbf3-8c7a-4e32-937d-baea03567dee] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:01:05.804524 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-b4e19379-2213-4b74-94a2-b6fb8032f95a tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:05.812051 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-b4e19379-2213-4b74-94a2-b6fb8032f95a tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:05.815384 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-d5f55932-79ce-4b38-9cb7-86347e75ed30 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24af0562e2aa43ca9d601be5e16fe9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ee9a43087d5497da3af9fbf68c4572d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:01:05.825021 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-b4e19379-2213-4b74-94a2-b6fb8032f95a tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:05.826003 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-b4e19379-2213-4b74-94a2-b6fb8032f95a tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:05.827917 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-d5f55932-79ce-4b38-9cb7-86347e75ed30 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] 10.222.0.47 "GET /compute/v2.1/servers/c74e760d-0b53-4508-ae21-494989132c3a" status: 200 len: 1521 microversion: 2.1 time: 1.234872 Feb 19 05:01:05.841142 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 95/168] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:01:04 2021] GET /compute/v2.1/servers/c74e760d-0b53-4508-ae21-494989132c3a => generated 1521 bytes in 1248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:01:05.846795 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-911d71f8-15a3-4488-aef6-f8c17a19e6ed tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:01:05.847955 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-911d71f8-15a3-4488-aef6-f8c17a19e6ed tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] [instance: 798b77ff-c3ca-4c65-a120-db12ad953621] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:01:05.880024 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-911d71f8-15a3-4488-aef6-f8c17a19e6ed tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:05.883384 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-911d71f8-15a3-4488-aef6-f8c17a19e6ed tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:05.891967 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-911d71f8-15a3-4488-aef6-f8c17a19e6ed tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:05.892701 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-911d71f8-15a3-4488-aef6-f8c17a19e6ed tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:06.170942 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-911d71f8-15a3-4488-aef6-f8c17a19e6ed tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] 10.222.0.47 "POST /compute/v2.1/servers/798b77ff-c3ca-4c65-a120-db12ad953621/action" status: 200 len: 17960 microversion: 2.20 time: 0.327931 Feb 19 05:01:06.172195 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 96/169] 10.222.0.47 () {62 vars in 1309 bytes} [Fri Feb 19 05:01:05 2021] POST /compute/v2.1/servers/798b77ff-c3ca-4c65-a120-db12ad953621/action => generated 17960 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 19 05:01:06.178367 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-181e6a15-53f4-459a-81d1-33087ef73246 tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:01:06.182831 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-181e6a15-53f4-459a-81d1-33087ef73246 tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] [instance: 65b5a76b-3d64-4b51-b955-04f6bdc76253] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:01:06.428430 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-181e6a15-53f4-459a-81d1-33087ef73246 tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ac58c346fa4d569782f22a3394e22a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f6827c056bf4dc0b68a527187f4be9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:01:06.497640 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-181e6a15-53f4-459a-81d1-33087ef73246 tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] 10.222.0.47 "GET /compute/v2.1/servers/65b5a76b-3d64-4b51-b955-04f6bdc76253" status: 200 len: 1214 microversion: 2.1 time: 0.316857 Feb 19 05:01:06.498752 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 97/170] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:01:06 2021] GET /compute/v2.1/servers/65b5a76b-3d64-4b51-b955-04f6bdc76253 => generated 1214 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:01:06.555807 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-df31efbc-e562-4ec1-87f9-183f69e4dd2f tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:01:06.564819 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-df31efbc-e562-4ec1-87f9-183f69e4dd2f tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] [instance: be65ea57-bc8d-4bce-80c3-33d8b6007ed1] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:01:06.591635 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-df31efbc-e562-4ec1-87f9-183f69e4dd2f tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:06.592121 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-df31efbc-e562-4ec1-87f9-183f69e4dd2f tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:06.602322 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-df31efbc-e562-4ec1-87f9-183f69e4dd2f tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:06.606952 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-df31efbc-e562-4ec1-87f9-183f69e4dd2f tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:06.781137 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-b4e19379-2213-4b74-94a2-b6fb8032f95a tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628d846121a14be78329ccc727c8869d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa473e12960449bbb0713a709e0abe4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:01:06.797394 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-b4e19379-2213-4b74-94a2-b6fb8032f95a tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] 10.222.0.47 "GET /compute/v2.1/servers/2182cbf3-8c7a-4e32-937d-baea03567dee" status: 200 len: 1317 microversion: 2.1 time: 1.065108 Feb 19 05:01:06.815813 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 74/171] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:01:05 2021] GET /compute/v2.1/servers/2182cbf3-8c7a-4e32-937d-baea03567dee => generated 1317 bytes in 1085 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:01:06.822972 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [req-8a16602b-1620-4b9f-9449-e50f93574cf3 req-3bcfeb20-8ef4-46f9-a66b-65e9c6920035 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "be65ea57-bc8d-4bce-80c3-33d8b6007ed1", "tag": "d8d91e89-f645-4300-857f-325550442803"}]} {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:01:06.826289 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 05:01:06.826289 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: warnings.warn(msg) Feb 19 05:01:06.838312 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [req-8a16602b-1620-4b9f-9449-e50f93574cf3 req-3bcfeb20-8ef4-46f9-a66b-65e9c6920035 service nova] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:06.839571 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [req-8a16602b-1620-4b9f-9449-e50f93574cf3 req-3bcfeb20-8ef4-46f9-a66b-65e9c6920035 service nova] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:06.870789 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.compute.server_external_events [req-8a16602b-1620-4b9f-9449-e50f93574cf3 req-3bcfeb20-8ef4-46f9-a66b-65e9c6920035 service nova] Creating event network-changed:d8d91e89-f645-4300-857f-325550442803 for instance be65ea57-bc8d-4bce-80c3-33d8b6007ed1 on hv-cinder-77642 Feb 19 05:01:06.880170 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [req-8a16602b-1620-4b9f-9449-e50f93574cf3 req-3bcfeb20-8ef4-46f9-a66b-65e9c6920035 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061112 Feb 19 05:01:06.882278 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 75/172] 10.222.0.47 () {64 vars in 1308 bytes} [Fri Feb 19 05:01:06 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 05:01:06.890838 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-be9369ff-4777-4e78-808b-13d52d19f7f2 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:01:06.892551 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-be9369ff-4777-4e78-808b-13d52d19f7f2 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] [instance: c74e760d-0b53-4508-ae21-494989132c3a] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:01:06.906919 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-be9369ff-4777-4e78-808b-13d52d19f7f2 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:06.907796 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-be9369ff-4777-4e78-808b-13d52d19f7f2 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:06.907936 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-df31efbc-e562-4ec1-87f9-183f69e4dd2f tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] 10.222.0.47 "POST /compute/v2.1/servers/be65ea57-bc8d-4bce-80c3-33d8b6007ed1/action" status: 200 len: 14 microversion: 2.1 time: 0.369915 Feb 19 05:01:06.908628 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 98/173] 10.222.0.47 () {60 vars in 1268 bytes} [Fri Feb 19 05:01:06 2021] POST /compute/v2.1/servers/be65ea57-bc8d-4bce-80c3-33d8b6007ed1/action => generated 14 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 19 05:01:06.910004 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-be9369ff-4777-4e78-808b-13d52d19f7f2 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:06.911154 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-be9369ff-4777-4e78-808b-13d52d19f7f2 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:07.188100 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-41745d78-1e7c-4fc1-8df3-065cb54f827b tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:01:07.189255 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-41745d78-1e7c-4fc1-8df3-065cb54f827b tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] [instance: 798b77ff-c3ca-4c65-a120-db12ad953621] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:01:07.205093 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-41745d78-1e7c-4fc1-8df3-065cb54f827b tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:07.205602 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-41745d78-1e7c-4fc1-8df3-065cb54f827b tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:07.206473 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-41745d78-1e7c-4fc1-8df3-065cb54f827b tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:07.206976 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-41745d78-1e7c-4fc1-8df3-065cb54f827b tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:07.287588 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-be9369ff-4777-4e78-808b-13d52d19f7f2 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24af0562e2aa43ca9d601be5e16fe9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ee9a43087d5497da3af9fbf68c4572d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:01:07.300375 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-be9369ff-4777-4e78-808b-13d52d19f7f2 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] 10.222.0.47 "GET /compute/v2.1/servers/c74e760d-0b53-4508-ae21-494989132c3a" status: 200 len: 1521 microversion: 2.1 time: 0.416246 Feb 19 05:01:07.307322 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 76/174] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:01:06 2021] GET /compute/v2.1/servers/c74e760d-0b53-4508-ae21-494989132c3a => generated 1521 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:01:07.446698 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-41745d78-1e7c-4fc1-8df3-065cb54f827b tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] 10.222.0.47 "POST /compute/v2.1/servers/798b77ff-c3ca-4c65-a120-db12ad953621/action" status: 200 len: 19342 microversion: 2.20 time: 0.263191 Feb 19 05:01:07.448065 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 99/175] 10.222.0.47 () {62 vars in 1309 bytes} [Fri Feb 19 05:01:07 2021] POST /compute/v2.1/servers/798b77ff-c3ca-4c65-a120-db12ad953621/action => generated 19342 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Feb 19 05:01:07.519557 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-eae5a455-ad38-4e68-98ca-58bb49df26f4 tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:01:07.521191 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-eae5a455-ad38-4e68-98ca-58bb49df26f4 tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] [instance: 65b5a76b-3d64-4b51-b955-04f6bdc76253] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:01:07.531605 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-eae5a455-ad38-4e68-98ca-58bb49df26f4 tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:07.532425 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-eae5a455-ad38-4e68-98ca-58bb49df26f4 tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:07.533698 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-eae5a455-ad38-4e68-98ca-58bb49df26f4 tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:07.534528 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-eae5a455-ad38-4e68-98ca-58bb49df26f4 tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:07.734522 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-eae5a455-ad38-4e68-98ca-58bb49df26f4 tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ac58c346fa4d569782f22a3394e22a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f6827c056bf4dc0b68a527187f4be9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:01:07.757767 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-eae5a455-ad38-4e68-98ca-58bb49df26f4 tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] 10.222.0.47 "GET /compute/v2.1/servers/65b5a76b-3d64-4b51-b955-04f6bdc76253" status: 200 len: 1210 microversion: 2.1 time: 0.243407 Feb 19 05:01:07.762778 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 77/176] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:01:07 2021] GET /compute/v2.1/servers/65b5a76b-3d64-4b51-b955-04f6bdc76253 => generated 1210 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:01:07.827099 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-a79b500a-d5f6-46f6-a4f9-425349d32156 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:01:07.828264 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-a79b500a-d5f6-46f6-a4f9-425349d32156 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] [instance: 2182cbf3-8c7a-4e32-937d-baea03567dee] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:01:07.842073 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-a79b500a-d5f6-46f6-a4f9-425349d32156 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:07.842983 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-a79b500a-d5f6-46f6-a4f9-425349d32156 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:07.844188 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-a79b500a-d5f6-46f6-a4f9-425349d32156 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:07.844834 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-a79b500a-d5f6-46f6-a4f9-425349d32156 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:07.925908 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-54b43e26-fd4b-4f47-a220-1c9b56110f34 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:01:07.935982 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-54b43e26-fd4b-4f47-a220-1c9b56110f34 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] [instance: be65ea57-bc8d-4bce-80c3-33d8b6007ed1] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:01:07.966697 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-54b43e26-fd4b-4f47-a220-1c9b56110f34 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:07.967096 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-54b43e26-fd4b-4f47-a220-1c9b56110f34 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:07.979966 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-54b43e26-fd4b-4f47-a220-1c9b56110f34 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:07.980770 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-54b43e26-fd4b-4f47-a220-1c9b56110f34 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:08.215557 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-54b43e26-fd4b-4f47-a220-1c9b56110f34 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] 10.222.0.47 "POST /compute/v2.1/servers/be65ea57-bc8d-4bce-80c3-33d8b6007ed1/action" status: 200 len: 14 microversion: 2.1 time: 0.295717 Feb 19 05:01:08.220568 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 78/177] 10.222.0.47 () {60 vars in 1268 bytes} [Fri Feb 19 05:01:07 2021] POST /compute/v2.1/servers/be65ea57-bc8d-4bce-80c3-33d8b6007ed1/action => generated 14 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Feb 19 05:01:08.336869 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-6e163c53-e9e2-4d99-ba68-f77dfa29f935 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:01:08.337920 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-6e163c53-e9e2-4d99-ba68-f77dfa29f935 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] [instance: c74e760d-0b53-4508-ae21-494989132c3a] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:01:08.348153 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-6e163c53-e9e2-4d99-ba68-f77dfa29f935 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:08.348663 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-6e163c53-e9e2-4d99-ba68-f77dfa29f935 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:08.349537 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-6e163c53-e9e2-4d99-ba68-f77dfa29f935 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:08.350031 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-6e163c53-e9e2-4d99-ba68-f77dfa29f935 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:08.377573 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-a79b500a-d5f6-46f6-a4f9-425349d32156 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628d846121a14be78329ccc727c8869d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa473e12960449bbb0713a709e0abe4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:01:08.390980 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-a79b500a-d5f6-46f6-a4f9-425349d32156 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] 10.222.0.47 "GET /compute/v2.1/servers/2182cbf3-8c7a-4e32-937d-baea03567dee" status: 200 len: 1508 microversion: 2.1 time: 0.571712 Feb 19 05:01:08.391755 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 100/178] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:01:07 2021] GET /compute/v2.1/servers/2182cbf3-8c7a-4e32-937d-baea03567dee => generated 1508 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:01:08.414111 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-c2fada00-1c3b-4092-9ec8-03b1dc6b9000 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a406f7aa-c912-4fa8-a690-6741832a6689"}} {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:01:08.415667 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-c2fada00-1c3b-4092-9ec8-03b1dc6b9000 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] [instance: 2182cbf3-8c7a-4e32-937d-baea03567dee] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:01:08.424996 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-c2fada00-1c3b-4092-9ec8-03b1dc6b9000 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:08.425501 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-c2fada00-1c3b-4092-9ec8-03b1dc6b9000 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:08.430260 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-c2fada00-1c3b-4092-9ec8-03b1dc6b9000 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:08.430762 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-c2fada00-1c3b-4092-9ec8-03b1dc6b9000 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:08.690155 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.wsgi [None req-c2fada00-1c3b-4092-9ec8-03b1dc6b9000 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] HTTP exception thrown: Invalid volume: volume a406f7aa-c912-4fa8-a690-6741832a6689 is already attached to instances: 9b43c13a-0c7e-45d7-96b0-83fe593a8b08 Feb 19 05:01:08.690954 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-c2fada00-1c3b-4092-9ec8-03b1dc6b9000 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Returning 400 to user: Invalid volume: volume a406f7aa-c912-4fa8-a690-6741832a6689 is already attached to instances: 9b43c13a-0c7e-45d7-96b0-83fe593a8b08 {{(pid=98154) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 19 05:01:08.696069 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-c2fada00-1c3b-4092-9ec8-03b1dc6b9000 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] 10.222.0.47 "POST /compute/v2.1/servers/2182cbf3-8c7a-4e32-937d-baea03567dee/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.283838 Feb 19 05:01:08.701637 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 101/179] 10.222.0.47 () {60 vars in 1313 bytes} [Fri Feb 19 05:01:08 2021] POST /compute/v2.1/servers/2182cbf3-8c7a-4e32-937d-baea03567dee/os-volume_attachments => generated 174 bytes in 295 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Feb 19 05:01:08.708801 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-92a3a863-2ccc-4fff-b23e-0ae0714f741a tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:01:08.709373 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-92a3a863-2ccc-4fff-b23e-0ae0714f741a tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] [instance: 798b77ff-c3ca-4c65-a120-db12ad953621] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:01:08.719022 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-92a3a863-2ccc-4fff-b23e-0ae0714f741a tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:08.719563 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-92a3a863-2ccc-4fff-b23e-0ae0714f741a tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:08.720419 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-92a3a863-2ccc-4fff-b23e-0ae0714f741a tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:08.720905 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-92a3a863-2ccc-4fff-b23e-0ae0714f741a tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:08.917734 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-92a3a863-2ccc-4fff-b23e-0ae0714f741a tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] 10.222.0.47 "POST /compute/v2.1/servers/798b77ff-c3ca-4c65-a120-db12ad953621/action" status: 200 len: 21883 microversion: 2.20 time: 0.214580 Feb 19 05:01:08.918742 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 102/180] 10.222.0.47 () {62 vars in 1309 bytes} [Fri Feb 19 05:01:08 2021] POST /compute/v2.1/servers/798b77ff-c3ca-4c65-a120-db12ad953621/action => generated 21883 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 19 05:01:08.925894 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-a9fb0e8b-5090-4f27-8769-936d4ccc14fc tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:01:08.927378 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-a9fb0e8b-5090-4f27-8769-936d4ccc14fc tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] [instance: 65b5a76b-3d64-4b51-b955-04f6bdc76253] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:01:08.949072 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-a9fb0e8b-5090-4f27-8769-936d4ccc14fc tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:08.949801 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-a9fb0e8b-5090-4f27-8769-936d4ccc14fc tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:08.954921 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-a9fb0e8b-5090-4f27-8769-936d4ccc14fc tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:08.955683 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-a9fb0e8b-5090-4f27-8769-936d4ccc14fc tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:09.179156 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-a9fb0e8b-5090-4f27-8769-936d4ccc14fc tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ac58c346fa4d569782f22a3394e22a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f6827c056bf4dc0b68a527187f4be9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:01:09.197053 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-a9fb0e8b-5090-4f27-8769-936d4ccc14fc tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] 10.222.0.47 "GET /compute/v2.1/servers/65b5a76b-3d64-4b51-b955-04f6bdc76253" status: 200 len: 1274 microversion: 2.1 time: 0.276854 Feb 19 05:01:09.197726 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 103/181] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:01:08 2021] GET /compute/v2.1/servers/65b5a76b-3d64-4b51-b955-04f6bdc76253 => generated 1274 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:01:09.203071 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-5b25fea5-9fd7-4c4d-b025-ec8027295741 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:01:09.220119 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-5b25fea5-9fd7-4c4d-b025-ec8027295741 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] [instance: 9b43c13a-0c7e-45d7-96b0-83fe593a8b08] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:01:09.228508 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-5b25fea5-9fd7-4c4d-b025-ec8027295741 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:09.229016 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-5b25fea5-9fd7-4c4d-b025-ec8027295741 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:09.230613 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-5b25fea5-9fd7-4c4d-b025-ec8027295741 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:09.230613 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-5b25fea5-9fd7-4c4d-b025-ec8027295741 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:09.343959 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-6e163c53-e9e2-4d99-ba68-f77dfa29f935 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24af0562e2aa43ca9d601be5e16fe9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ee9a43087d5497da3af9fbf68c4572d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:01:09.364837 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-6e163c53-e9e2-4d99-ba68-f77dfa29f935 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] 10.222.0.47 "GET /compute/v2.1/servers/c74e760d-0b53-4508-ae21-494989132c3a" status: 200 len: 1521 microversion: 2.1 time: 1.032895 Feb 19 05:01:09.369469 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 79/182] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:01:08 2021] GET /compute/v2.1/servers/c74e760d-0b53-4508-ae21-494989132c3a => generated 1521 bytes in 1040 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 05:01:09.380399 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-eae35e13-2571-460e-9111-7ec84738ca14 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:01:09.381521 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-eae35e13-2571-460e-9111-7ec84738ca14 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] [instance: be65ea57-bc8d-4bce-80c3-33d8b6007ed1] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:01:09.390676 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-eae35e13-2571-460e-9111-7ec84738ca14 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:09.391391 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-eae35e13-2571-460e-9111-7ec84738ca14 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:09.404291 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-eae35e13-2571-460e-9111-7ec84738ca14 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:09.404842 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-eae35e13-2571-460e-9111-7ec84738ca14 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:09.641098 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-eae35e13-2571-460e-9111-7ec84738ca14 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] 10.222.0.47 "POST /compute/v2.1/servers/be65ea57-bc8d-4bce-80c3-33d8b6007ed1/action" status: 200 len: 14 microversion: 2.1 time: 0.269963 Feb 19 05:01:09.646151 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 80/183] 10.222.0.47 () {60 vars in 1268 bytes} [Fri Feb 19 05:01:09 2021] POST /compute/v2.1/servers/be65ea57-bc8d-4bce-80c3-33d8b6007ed1/action => generated 14 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 19 05:01:09.822510 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.objects.instance [None req-5b25fea5-9fd7-4c4d-b025-ec8027295741 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lazy-loading 'services' on Instance uuid 9b43c13a-0c7e-45d7-96b0-83fe593a8b08 {{(pid=98154) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Feb 19 05:01:09.933832 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-8920f7d9-d746-4be3-b264-4994d00352b1 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:01:09.935368 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-8920f7d9-d746-4be3-b264-4994d00352b1 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] [instance: 798b77ff-c3ca-4c65-a120-db12ad953621] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:01:09.953306 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-8920f7d9-d746-4be3-b264-4994d00352b1 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:09.954074 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-8920f7d9-d746-4be3-b264-4994d00352b1 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:09.955178 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-8920f7d9-d746-4be3-b264-4994d00352b1 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:09.955914 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-8920f7d9-d746-4be3-b264-4994d00352b1 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:10.286980 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-8920f7d9-d746-4be3-b264-4994d00352b1 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] 10.222.0.47 "POST /compute/v2.1/servers/798b77ff-c3ca-4c65-a120-db12ad953621/action" status: 200 len: 23294 microversion: 2.20 time: 0.357345 Feb 19 05:01:10.293927 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 81/184] 10.222.0.47 () {62 vars in 1309 bytes} [Fri Feb 19 05:01:09 2021] POST /compute/v2.1/servers/798b77ff-c3ca-4c65-a120-db12ad953621/action => generated 23294 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 19 05:01:10.311023 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-231128e0-e912-46e8-8851-91a4e744f8b7 tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:01:10.320840 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-231128e0-e912-46e8-8851-91a4e744f8b7 tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] [instance: 65b5a76b-3d64-4b51-b955-04f6bdc76253] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:01:10.347567 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-5b25fea5-9fd7-4c4d-b025-ec8027295741 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] 10.222.0.47 "DELETE /compute/v2.1/servers/9b43c13a-0c7e-45d7-96b0-83fe593a8b08/os-volume_attachments/a406f7aa-c912-4fa8-a690-6741832a6689" status: 202 len: 0 microversion: 2.1 time: 1.145743 Feb 19 05:01:10.354097 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 104/185] 10.222.0.47 () {58 vars in 1406 bytes} [Fri Feb 19 05:01:09 2021] DELETE /compute/v2.1/servers/9b43c13a-0c7e-45d7-96b0-83fe593a8b08/os-volume_attachments/a406f7aa-c912-4fa8-a690-6741832a6689 => generated 0 bytes in 1156 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 19 05:01:10.366047 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-231128e0-e912-46e8-8851-91a4e744f8b7 tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:10.366882 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-231128e0-e912-46e8-8851-91a4e744f8b7 tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:10.377223 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-231128e0-e912-46e8-8851-91a4e744f8b7 tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:10.378158 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-231128e0-e912-46e8-8851-91a4e744f8b7 tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:10.399928 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-a04e641b-e7d2-46f4-8a25-1234d45bb539 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:01:10.401116 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-a04e641b-e7d2-46f4-8a25-1234d45bb539 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] [instance: c74e760d-0b53-4508-ae21-494989132c3a] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:01:10.420627 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-a04e641b-e7d2-46f4-8a25-1234d45bb539 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:10.422343 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-a04e641b-e7d2-46f4-8a25-1234d45bb539 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:10.424902 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-a04e641b-e7d2-46f4-8a25-1234d45bb539 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:10.428310 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-a04e641b-e7d2-46f4-8a25-1234d45bb539 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:11.176975 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-231128e0-e912-46e8-8851-91a4e744f8b7 tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ac58c346fa4d569782f22a3394e22a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f6827c056bf4dc0b68a527187f4be9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:01:11.209132 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-231128e0-e912-46e8-8851-91a4e744f8b7 tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] 10.222.0.47 "GET /compute/v2.1/servers/65b5a76b-3d64-4b51-b955-04f6bdc76253" status: 200 len: 1272 microversion: 2.1 time: 0.911257 Feb 19 05:01:11.211982 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 82/186] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:01:10 2021] GET /compute/v2.1/servers/65b5a76b-3d64-4b51-b955-04f6bdc76253 => generated 1272 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:01:11.233059 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-bad137e6-7362-4be1-8f58-50f5724cbe4a tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:01:11.233059 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-bad137e6-7362-4be1-8f58-50f5724cbe4a tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] [instance: be65ea57-bc8d-4bce-80c3-33d8b6007ed1] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:01:11.248051 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-bad137e6-7362-4be1-8f58-50f5724cbe4a tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:11.249020 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-bad137e6-7362-4be1-8f58-50f5724cbe4a tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:11.250933 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-bad137e6-7362-4be1-8f58-50f5724cbe4a tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:11.251970 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-bad137e6-7362-4be1-8f58-50f5724cbe4a tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:11.552527 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-bad137e6-7362-4be1-8f58-50f5724cbe4a tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] 10.222.0.47 "POST /compute/v2.1/servers/be65ea57-bc8d-4bce-80c3-33d8b6007ed1/action" status: 200 len: 14 microversion: 2.1 time: 0.333936 Feb 19 05:01:11.553960 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 83/187] 10.222.0.47 () {60 vars in 1268 bytes} [Fri Feb 19 05:01:11 2021] POST /compute/v2.1/servers/be65ea57-bc8d-4bce-80c3-33d8b6007ed1/action => generated 14 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 19 05:01:11.567692 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-0dac232b-cd03-483f-8ad0-8efb63d1e791 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:01:11.577320 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-0dac232b-cd03-483f-8ad0-8efb63d1e791 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] [instance: 798b77ff-c3ca-4c65-a120-db12ad953621] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:01:11.619044 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-0dac232b-cd03-483f-8ad0-8efb63d1e791 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:11.622277 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-0dac232b-cd03-483f-8ad0-8efb63d1e791 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:11.626864 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-0dac232b-cd03-483f-8ad0-8efb63d1e791 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:11.632840 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-0dac232b-cd03-483f-8ad0-8efb63d1e791 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:11.644265 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-a04e641b-e7d2-46f4-8a25-1234d45bb539 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24af0562e2aa43ca9d601be5e16fe9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ee9a43087d5497da3af9fbf68c4572d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:01:11.662345 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-a04e641b-e7d2-46f4-8a25-1234d45bb539 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] 10.222.0.47 "GET /compute/v2.1/servers/c74e760d-0b53-4508-ae21-494989132c3a" status: 200 len: 1521 microversion: 2.1 time: 1.268338 Feb 19 05:01:11.663012 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 105/188] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:01:10 2021] GET /compute/v2.1/servers/c74e760d-0b53-4508-ae21-494989132c3a => generated 1521 bytes in 1271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 05:01:11.917197 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-0dac232b-cd03-483f-8ad0-8efb63d1e791 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] 10.222.0.47 "POST /compute/v2.1/servers/798b77ff-c3ca-4c65-a120-db12ad953621/action" status: 200 len: 24882 microversion: 2.20 time: 0.360211 Feb 19 05:01:11.917919 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 84/189] 10.222.0.47 () {62 vars in 1309 bytes} [Fri Feb 19 05:01:11 2021] POST /compute/v2.1/servers/798b77ff-c3ca-4c65-a120-db12ad953621/action => generated 24882 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 19 05:01:12.248233 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-c6f9d269-e841-4d76-8100-6a443842f46a tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:01:12.248944 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-c6f9d269-e841-4d76-8100-6a443842f46a tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] [instance: 65b5a76b-3d64-4b51-b955-04f6bdc76253] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:01:12.258892 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-c6f9d269-e841-4d76-8100-6a443842f46a tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:12.259434 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-c6f9d269-e841-4d76-8100-6a443842f46a tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:12.260895 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-c6f9d269-e841-4d76-8100-6a443842f46a tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:12.261388 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-c6f9d269-e841-4d76-8100-6a443842f46a tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:12.575614 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-78f4b141-645b-45ed-a565-1fc89f9dfa06 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:01:12.578728 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-78f4b141-645b-45ed-a565-1fc89f9dfa06 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] [instance: be65ea57-bc8d-4bce-80c3-33d8b6007ed1] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:01:12.598323 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-78f4b141-645b-45ed-a565-1fc89f9dfa06 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:12.600997 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-78f4b141-645b-45ed-a565-1fc89f9dfa06 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:12.602848 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-78f4b141-645b-45ed-a565-1fc89f9dfa06 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:12.604034 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-78f4b141-645b-45ed-a565-1fc89f9dfa06 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:12.908724 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-78f4b141-645b-45ed-a565-1fc89f9dfa06 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] 10.222.0.47 "POST /compute/v2.1/servers/be65ea57-bc8d-4bce-80c3-33d8b6007ed1/action" status: 200 len: 14 microversion: 2.1 time: 0.345284 Feb 19 05:01:12.911706 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 85/190] 10.222.0.47 () {60 vars in 1268 bytes} [Fri Feb 19 05:01:12 2021] POST /compute/v2.1/servers/be65ea57-bc8d-4bce-80c3-33d8b6007ed1/action => generated 14 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Feb 19 05:01:12.923545 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-9c0b00c6-fe0b-417f-ba79-416118c102c5 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:01:12.933576 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-9c0b00c6-fe0b-417f-ba79-416118c102c5 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] [instance: c74e760d-0b53-4508-ae21-494989132c3a] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:01:12.953408 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-9c0b00c6-fe0b-417f-ba79-416118c102c5 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:12.954665 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-9c0b00c6-fe0b-417f-ba79-416118c102c5 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:12.957480 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-9c0b00c6-fe0b-417f-ba79-416118c102c5 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:12.958975 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-9c0b00c6-fe0b-417f-ba79-416118c102c5 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:13.188939 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-c6f9d269-e841-4d76-8100-6a443842f46a tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ac58c346fa4d569782f22a3394e22a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f6827c056bf4dc0b68a527187f4be9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:01:13.215027 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-c6f9d269-e841-4d76-8100-6a443842f46a tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] 10.222.0.47 "GET /compute/v2.1/servers/65b5a76b-3d64-4b51-b955-04f6bdc76253" status: 200 len: 1314 microversion: 2.1 time: 0.969833 Feb 19 05:01:13.217263 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 106/191] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:01:12 2021] GET /compute/v2.1/servers/65b5a76b-3d64-4b51-b955-04f6bdc76253 => generated 1314 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:01:13.250624 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-33955786-e39d-4e69-87c5-dadf61c830f5 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:01:13.253096 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-33955786-e39d-4e69-87c5-dadf61c830f5 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] [instance: 798b77ff-c3ca-4c65-a120-db12ad953621] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:01:13.264963 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-33955786-e39d-4e69-87c5-dadf61c830f5 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:13.266428 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-33955786-e39d-4e69-87c5-dadf61c830f5 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:13.267535 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-33955786-e39d-4e69-87c5-dadf61c830f5 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:13.268351 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-33955786-e39d-4e69-87c5-dadf61c830f5 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:13.495678 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-33955786-e39d-4e69-87c5-dadf61c830f5 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] 10.222.0.47 "POST /compute/v2.1/servers/798b77ff-c3ca-4c65-a120-db12ad953621/action" status: 200 len: 26206 microversion: 2.20 time: 0.264627 Feb 19 05:01:13.496898 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 107/192] 10.222.0.47 () {62 vars in 1309 bytes} [Fri Feb 19 05:01:13 2021] POST /compute/v2.1/servers/798b77ff-c3ca-4c65-a120-db12ad953621/action => generated 26206 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 19 05:01:13.905256 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-9c0b00c6-fe0b-417f-ba79-416118c102c5 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24af0562e2aa43ca9d601be5e16fe9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ee9a43087d5497da3af9fbf68c4572d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:01:13.916150 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-9c0b00c6-fe0b-417f-ba79-416118c102c5 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] 10.222.0.47 "GET /compute/v2.1/servers/c74e760d-0b53-4508-ae21-494989132c3a" status: 200 len: 1521 microversion: 2.1 time: 1.001971 Feb 19 05:01:13.936672 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-fe0596f8-e3fd-4088-a740-1cd7993ca28a tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:01:13.938159 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-fe0596f8-e3fd-4088-a740-1cd7993ca28a tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] [instance: be65ea57-bc8d-4bce-80c3-33d8b6007ed1] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:01:13.942293 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 86/193] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:01:12 2021] GET /compute/v2.1/servers/c74e760d-0b53-4508-ae21-494989132c3a => generated 1521 bytes in 1028 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:01:13.950840 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-fe0596f8-e3fd-4088-a740-1cd7993ca28a tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:13.951660 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-fe0596f8-e3fd-4088-a740-1cd7993ca28a tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:13.952721 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-fe0596f8-e3fd-4088-a740-1cd7993ca28a tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:13.953389 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-fe0596f8-e3fd-4088-a740-1cd7993ca28a tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:14.101583 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-fe0596f8-e3fd-4088-a740-1cd7993ca28a tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] 10.222.0.47 "POST /compute/v2.1/servers/be65ea57-bc8d-4bce-80c3-33d8b6007ed1/action" status: 200 len: 14 microversion: 2.1 time: 0.172314 Feb 19 05:01:14.102723 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 108/194] 10.222.0.47 () {60 vars in 1268 bytes} [Fri Feb 19 05:01:13 2021] POST /compute/v2.1/servers/be65ea57-bc8d-4bce-80c3-33d8b6007ed1/action => generated 14 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 19 05:01:14.248496 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-9152fc07-2a2e-4fff-809c-6b32a2377b78 tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:01:14.249780 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-9152fc07-2a2e-4fff-809c-6b32a2377b78 tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] [instance: 65b5a76b-3d64-4b51-b955-04f6bdc76253] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:01:14.263878 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-9152fc07-2a2e-4fff-809c-6b32a2377b78 tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:14.264912 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-9152fc07-2a2e-4fff-809c-6b32a2377b78 tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:14.266541 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-9152fc07-2a2e-4fff-809c-6b32a2377b78 tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:14.267102 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-9152fc07-2a2e-4fff-809c-6b32a2377b78 tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:14.513413 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-c6b406c2-cc50-47dc-944a-cd64b827d2f9 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:01:14.515439 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-c6b406c2-cc50-47dc-944a-cd64b827d2f9 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] [instance: 798b77ff-c3ca-4c65-a120-db12ad953621] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:01:14.527193 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-c6b406c2-cc50-47dc-944a-cd64b827d2f9 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:14.528170 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-c6b406c2-cc50-47dc-944a-cd64b827d2f9 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:14.529254 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-c6b406c2-cc50-47dc-944a-cd64b827d2f9 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:14.529955 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-c6b406c2-cc50-47dc-944a-cd64b827d2f9 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:14.722351 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-c6b406c2-cc50-47dc-944a-cd64b827d2f9 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] 10.222.0.47 "POST /compute/v2.1/servers/798b77ff-c3ca-4c65-a120-db12ad953621/action" status: 200 len: 27057 microversion: 2.20 time: 0.213575 Feb 19 05:01:14.728642 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 109/195] 10.222.0.47 () {62 vars in 1309 bytes} [Fri Feb 19 05:01:14 2021] POST /compute/v2.1/servers/798b77ff-c3ca-4c65-a120-db12ad953621/action => generated 27057 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Feb 19 05:01:14.736429 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-c761bc7d-b21b-4a3f-94fa-c0708f48f187 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1064824216", "imageRef": "53cdf9de-e495-4ca8-845f-6be2bf32cecb", "flavorRef": "452", "networks": [{"uuid": "f995194d-dcd5-48ad-baed-944751a68000"}]}} {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:01:14.829648 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.network.neutron [None req-c761bc7d-b21b-4a3f-94fa-c0708f48f187 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] validate_networks() for [('f995194d-dcd5-48ad-baed-944751a68000', None, None, None)] {{(pid=98154) validate_networks /opt/stack/nova/nova/network/neutron.py:2345}} Feb 19 05:01:15.112544 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-9152fc07-2a2e-4fff-809c-6b32a2377b78 tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ac58c346fa4d569782f22a3394e22a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f6827c056bf4dc0b68a527187f4be9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:01:15.126173 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-9152fc07-2a2e-4fff-809c-6b32a2377b78 tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] 10.222.0.47 "GET /compute/v2.1/servers/65b5a76b-3d64-4b51-b955-04f6bdc76253" status: 200 len: 1314 microversion: 2.1 time: 0.882518 Feb 19 05:01:15.127050 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 87/196] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:01:14 2021] GET /compute/v2.1/servers/65b5a76b-3d64-4b51-b955-04f6bdc76253 => generated 1314 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:01:15.138740 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-cfaa471c-d288-49ce-bf46-ae7f2d30eed2 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:01:15.140418 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-cfaa471c-d288-49ce-bf46-ae7f2d30eed2 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] [instance: c74e760d-0b53-4508-ae21-494989132c3a] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:01:15.153345 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-cfaa471c-d288-49ce-bf46-ae7f2d30eed2 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:15.154007 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-cfaa471c-d288-49ce-bf46-ae7f2d30eed2 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:15.154982 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-cfaa471c-d288-49ce-bf46-ae7f2d30eed2 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:15.161656 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-cfaa471c-d288-49ce-bf46-ae7f2d30eed2 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:16.121292 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-cfaa471c-d288-49ce-bf46-ae7f2d30eed2 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24af0562e2aa43ca9d601be5e16fe9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ee9a43087d5497da3af9fbf68c4572d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:01:16.162871 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-cfaa471c-d288-49ce-bf46-ae7f2d30eed2 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] 10.222.0.47 "GET /compute/v2.1/servers/c74e760d-0b53-4508-ae21-494989132c3a" status: 200 len: 1521 microversion: 2.1 time: 1.032506 Feb 19 05:01:16.166639 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 88/197] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:01:15 2021] GET /compute/v2.1/servers/c74e760d-0b53-4508-ae21-494989132c3a => generated 1521 bytes in 1038 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:01:16.177147 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-f97824a4-c236-405f-950a-ccdeed14493b tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:01:16.180133 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-f97824a4-c236-405f-950a-ccdeed14493b tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] [instance: be65ea57-bc8d-4bce-80c3-33d8b6007ed1] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:01:16.198143 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-f97824a4-c236-405f-950a-ccdeed14493b tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:16.199462 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-f97824a4-c236-405f-950a-ccdeed14493b tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:16.201532 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-f97824a4-c236-405f-950a-ccdeed14493b tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:16.202636 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-f97824a4-c236-405f-950a-ccdeed14493b tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:16.455587 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-f97824a4-c236-405f-950a-ccdeed14493b tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] 10.222.0.47 "POST /compute/v2.1/servers/be65ea57-bc8d-4bce-80c3-33d8b6007ed1/action" status: 200 len: 10037 microversion: 2.1 time: 0.286428 Feb 19 05:01:16.456618 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 89/198] 10.222.0.47 () {60 vars in 1268 bytes} [Fri Feb 19 05:01:16 2021] POST /compute/v2.1/servers/be65ea57-bc8d-4bce-80c3-33d8b6007ed1/action => generated 10037 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 19 05:01:16.463919 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-434f41fe-401c-4939-89b3-499ed5295c22 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:01:16.465555 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-434f41fe-401c-4939-89b3-499ed5295c22 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] [instance: 798b77ff-c3ca-4c65-a120-db12ad953621] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:01:16.477369 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-434f41fe-401c-4939-89b3-499ed5295c22 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:16.478189 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-434f41fe-401c-4939-89b3-499ed5295c22 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:16.479467 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-434f41fe-401c-4939-89b3-499ed5295c22 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:16.480170 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-434f41fe-401c-4939-89b3-499ed5295c22 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:16.558620 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.virt.hardware [None req-c761bc7d-b21b-4a3f-94fa-c0708f48f187 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Flavor limits 0:0:0 {{(pid=98154) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 19 05:01:16.559881 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.virt.hardware [None req-c761bc7d-b21b-4a3f-94fa-c0708f48f187 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Image limits 0:0:0 {{(pid=98154) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Feb 19 05:01:16.561178 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.virt.hardware [None req-c761bc7d-b21b-4a3f-94fa-c0708f48f187 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Flavor pref 0:0:0 {{(pid=98154) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 19 05:01:16.562213 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.virt.hardware [None req-c761bc7d-b21b-4a3f-94fa-c0708f48f187 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Image pref 0:0:0 {{(pid=98154) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Feb 19 05:01:16.563418 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.virt.hardware [None req-c761bc7d-b21b-4a3f-94fa-c0708f48f187 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98154) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Feb 19 05:01:16.583779 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-c761bc7d-b21b-4a3f-94fa-c0708f48f187 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:16.584669 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-c761bc7d-b21b-4a3f-94fa-c0708f48f187 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:16.586581 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-c761bc7d-b21b-4a3f-94fa-c0708f48f187 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:16.587652 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-c761bc7d-b21b-4a3f-94fa-c0708f48f187 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:16.665898 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-434f41fe-401c-4939-89b3-499ed5295c22 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] 10.222.0.47 "POST /compute/v2.1/servers/798b77ff-c3ca-4c65-a120-db12ad953621/action" status: 200 len: 27640 microversion: 2.20 time: 0.206805 Feb 19 05:01:16.666617 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 90/199] 10.222.0.47 () {62 vars in 1309 bytes} [Fri Feb 19 05:01:16 2021] POST /compute/v2.1/servers/798b77ff-c3ca-4c65-a120-db12ad953621/action => generated 27640 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 19 05:01:16.669527 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.quota [None req-c761bc7d-b21b-4a3f-94fa-c0708f48f187 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Getting quotas for project aa473e12960449bbb0713a709e0abe4e. Resources: {'instances', 'ram', 'cores'} {{(pid=98154) _get_quotas /opt/stack/nova/nova/quota.py:388}} Feb 19 05:01:16.680142 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.quota [None req-c761bc7d-b21b-4a3f-94fa-c0708f48f187 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Getting quotas for user 628d846121a14be78329ccc727c8869d and project aa473e12960449bbb0713a709e0abe4e. Resources: {'instances', 'ram', 'cores'} {{(pid=98154) _get_quotas /opt/stack/nova/nova/quota.py:380}} Feb 19 05:01:16.682693 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-28c92e06-0d0f-42d9-8efa-e7ed64ca4975 tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:01:16.683504 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-28c92e06-0d0f-42d9-8efa-e7ed64ca4975 tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] [instance: 65b5a76b-3d64-4b51-b955-04f6bdc76253] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:01:16.705335 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-c761bc7d-b21b-4a3f-94fa-c0708f48f187 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Going to run 1 instances... {{(pid=98154) _provision_instances /opt/stack/nova/nova/compute/api.py:1264}} Feb 19 05:01:16.705596 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-28c92e06-0d0f-42d9-8efa-e7ed64ca4975 tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:16.705829 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-28c92e06-0d0f-42d9-8efa-e7ed64ca4975 tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:16.711718 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-28c92e06-0d0f-42d9-8efa-e7ed64ca4975 tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:16.712836 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-c761bc7d-b21b-4a3f-94fa-c0708f48f187 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] [instance: 3aafde29-2f77-4921-9580-05730dd73604] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='53cdf9de-e495-4ca8-845f-6be2bf32cecb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98154) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1666}} Feb 19 05:01:16.714841 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-28c92e06-0d0f-42d9-8efa-e7ed64ca4975 tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:16.792394 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-c761bc7d-b21b-4a3f-94fa-c0708f48f187 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.061989 Feb 19 05:01:16.793430 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 110/200] 10.222.0.47 () {60 vars in 1137 bytes} [Fri Feb 19 05:01:14 2021] POST /compute/v2.1/servers => generated 380 bytes in 2064 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 19 05:01:16.805316 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [req-113bc59f-600f-4cf8-929c-0dba7f6ff4d6 req-03fae76a-b481-4963-9df0-d27d2c77fb1b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "65b5a76b-3d64-4b51-b955-04f6bdc76253", "tag": "e233c19f-946c-4ce2-98af-3c1203421dda"}]} {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:01:16.807753 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 05:01:16.807753 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: warnings.warn(msg) Feb 19 05:01:16.819584 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [req-113bc59f-600f-4cf8-929c-0dba7f6ff4d6 req-03fae76a-b481-4963-9df0-d27d2c77fb1b service nova] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:16.820392 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [req-113bc59f-600f-4cf8-929c-0dba7f6ff4d6 req-03fae76a-b481-4963-9df0-d27d2c77fb1b service nova] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:16.846766 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.compute.server_external_events [req-113bc59f-600f-4cf8-929c-0dba7f6ff4d6 req-03fae76a-b481-4963-9df0-d27d2c77fb1b service nova] Creating event network-changed:e233c19f-946c-4ce2-98af-3c1203421dda for instance 65b5a76b-3d64-4b51-b955-04f6bdc76253 on hv-cinder-77642 Feb 19 05:01:16.853311 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [req-113bc59f-600f-4cf8-929c-0dba7f6ff4d6 req-03fae76a-b481-4963-9df0-d27d2c77fb1b service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052341 Feb 19 05:01:16.854533 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 111/201] 10.222.0.47 () {64 vars in 1308 bytes} [Fri Feb 19 05:01:16 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 05:01:16.860956 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-63307329-6703-4534-8882-b4d6887c5b87 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:01:16.862088 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-63307329-6703-4534-8882-b4d6887c5b87 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] [instance: 3aafde29-2f77-4921-9580-05730dd73604] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:01:17.130470 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-63307329-6703-4534-8882-b4d6887c5b87 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628d846121a14be78329ccc727c8869d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa473e12960449bbb0713a709e0abe4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:01:17.150232 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-63307329-6703-4534-8882-b4d6887c5b87 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] 10.222.0.47 "GET /compute/v2.1/servers/3aafde29-2f77-4921-9580-05730dd73604" status: 200 len: 1218 microversion: 2.1 time: 0.293943 Feb 19 05:01:17.151255 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 112/202] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:01:16 2021] GET /compute/v2.1/servers/3aafde29-2f77-4921-9580-05730dd73604 => generated 1218 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:01:17.183465 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-4057ead0-39b9-4b07-9c11-e7f5f004d19f tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:01:17.184515 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-4057ead0-39b9-4b07-9c11-e7f5f004d19f tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] [instance: c74e760d-0b53-4508-ae21-494989132c3a] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:01:17.196543 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-4057ead0-39b9-4b07-9c11-e7f5f004d19f tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:17.197220 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-4057ead0-39b9-4b07-9c11-e7f5f004d19f tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:17.198425 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-4057ead0-39b9-4b07-9c11-e7f5f004d19f tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:17.199185 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-4057ead0-39b9-4b07-9c11-e7f5f004d19f tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:17.947939 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-28c92e06-0d0f-42d9-8efa-e7ed64ca4975 tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ac58c346fa4d569782f22a3394e22a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f6827c056bf4dc0b68a527187f4be9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:01:18.004735 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-28c92e06-0d0f-42d9-8efa-e7ed64ca4975 tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] 10.222.0.47 "GET /compute/v2.1/servers/65b5a76b-3d64-4b51-b955-04f6bdc76253" status: 200 len: 1314 microversion: 2.1 time: 1.335377 Feb 19 05:01:18.005974 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 91/203] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:01:16 2021] GET /compute/v2.1/servers/65b5a76b-3d64-4b51-b955-04f6bdc76253 => generated 1314 bytes in 1339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:01:18.031811 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-21ed7cf7-2df5-4c9d-a6bf-6b43e0691193 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:01:18.033753 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-21ed7cf7-2df5-4c9d-a6bf-6b43e0691193 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] [instance: be65ea57-bc8d-4bce-80c3-33d8b6007ed1] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:01:18.069880 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-21ed7cf7-2df5-4c9d-a6bf-6b43e0691193 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:18.071649 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-21ed7cf7-2df5-4c9d-a6bf-6b43e0691193 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:18.074458 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-21ed7cf7-2df5-4c9d-a6bf-6b43e0691193 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:18.075850 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-21ed7cf7-2df5-4c9d-a6bf-6b43e0691193 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:18.141500 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-4057ead0-39b9-4b07-9c11-e7f5f004d19f tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24af0562e2aa43ca9d601be5e16fe9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ee9a43087d5497da3af9fbf68c4572d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:01:18.162198 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-4057ead0-39b9-4b07-9c11-e7f5f004d19f tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] 10.222.0.47 "GET /compute/v2.1/servers/c74e760d-0b53-4508-ae21-494989132c3a" status: 200 len: 1521 microversion: 2.1 time: 0.979881 Feb 19 05:01:18.162198 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 113/204] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:01:17 2021] GET /compute/v2.1/servers/c74e760d-0b53-4508-ae21-494989132c3a => generated 1521 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 05:01:18.178101 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-35495415-461c-46dc-b548-09e93fea48e8 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:01:18.180061 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-35495415-461c-46dc-b548-09e93fea48e8 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] [instance: 798b77ff-c3ca-4c65-a120-db12ad953621] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:01:18.192813 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-35495415-461c-46dc-b548-09e93fea48e8 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:18.193570 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-35495415-461c-46dc-b548-09e93fea48e8 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:18.194973 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-35495415-461c-46dc-b548-09e93fea48e8 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:18.195714 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-35495415-461c-46dc-b548-09e93fea48e8 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:18.434648 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-21ed7cf7-2df5-4c9d-a6bf-6b43e0691193 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] 10.222.0.47 "POST /compute/v2.1/servers/be65ea57-bc8d-4bce-80c3-33d8b6007ed1/action" status: 200 len: 17107 microversion: 2.1 time: 0.426666 Feb 19 05:01:18.436244 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 92/205] 10.222.0.47 () {60 vars in 1268 bytes} [Fri Feb 19 05:01:18 2021] POST /compute/v2.1/servers/be65ea57-bc8d-4bce-80c3-33d8b6007ed1/action => generated 17107 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 19 05:01:18.442455 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-f0ae1ff5-4c40-497f-aa43-2aabb830db48 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:01:18.443585 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-f0ae1ff5-4c40-497f-aa43-2aabb830db48 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] [instance: 3aafde29-2f77-4921-9580-05730dd73604] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:01:18.452624 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-f0ae1ff5-4c40-497f-aa43-2aabb830db48 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:18.453250 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-f0ae1ff5-4c40-497f-aa43-2aabb830db48 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:18.454614 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-f0ae1ff5-4c40-497f-aa43-2aabb830db48 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:18.455198 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-f0ae1ff5-4c40-497f-aa43-2aabb830db48 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:18.536834 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-35495415-461c-46dc-b548-09e93fea48e8 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] 10.222.0.47 "POST /compute/v2.1/servers/798b77ff-c3ca-4c65-a120-db12ad953621/action" status: 200 len: 28016 microversion: 2.20 time: 0.374330 Feb 19 05:01:18.537974 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 114/206] 10.222.0.47 () {62 vars in 1309 bytes} [Fri Feb 19 05:01:18 2021] POST /compute/v2.1/servers/798b77ff-c3ca-4c65-a120-db12ad953621/action => generated 28016 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 19 05:01:18.653741 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-f0ae1ff5-4c40-497f-aa43-2aabb830db48 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628d846121a14be78329ccc727c8869d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa473e12960449bbb0713a709e0abe4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:01:18.668573 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-f0ae1ff5-4c40-497f-aa43-2aabb830db48 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] 10.222.0.47 "GET /compute/v2.1/servers/3aafde29-2f77-4921-9580-05730dd73604" status: 200 len: 1270 microversion: 2.1 time: 0.231303 Feb 19 05:01:18.669864 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 93/207] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:01:18 2021] GET /compute/v2.1/servers/3aafde29-2f77-4921-9580-05730dd73604 => generated 1270 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:01:19.031851 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-085bf906-9023-4bf8-92e2-0ddecd89903c tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:01:19.040437 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-085bf906-9023-4bf8-92e2-0ddecd89903c tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] [instance: 65b5a76b-3d64-4b51-b955-04f6bdc76253] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:01:19.057199 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-085bf906-9023-4bf8-92e2-0ddecd89903c tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:19.058558 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-085bf906-9023-4bf8-92e2-0ddecd89903c tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:19.060445 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-085bf906-9023-4bf8-92e2-0ddecd89903c tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:19.061648 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-085bf906-9023-4bf8-92e2-0ddecd89903c tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:19.186946 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-df78fea3-dfc8-4ee5-8285-2234a88890ea tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:01:19.191015 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-df78fea3-dfc8-4ee5-8285-2234a88890ea tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] [instance: c74e760d-0b53-4508-ae21-494989132c3a] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:01:19.210464 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-df78fea3-dfc8-4ee5-8285-2234a88890ea tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:19.212317 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-df78fea3-dfc8-4ee5-8285-2234a88890ea tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:19.214231 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-df78fea3-dfc8-4ee5-8285-2234a88890ea tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:19.215452 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-df78fea3-dfc8-4ee5-8285-2234a88890ea tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:19.681084 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-085bf906-9023-4bf8-92e2-0ddecd89903c tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ac58c346fa4d569782f22a3394e22a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f6827c056bf4dc0b68a527187f4be9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:01:19.693330 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-085bf906-9023-4bf8-92e2-0ddecd89903c tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] 10.222.0.47 "GET /compute/v2.1/servers/65b5a76b-3d64-4b51-b955-04f6bdc76253" status: 200 len: 1314 microversion: 2.1 time: 0.670299 Feb 19 05:01:19.693889 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 115/208] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:01:19 2021] GET /compute/v2.1/servers/65b5a76b-3d64-4b51-b955-04f6bdc76253 => generated 1314 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 05:01:19.726966 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-1ab66c27-8123-4ec4-b27b-d821a5723c69 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:01:19.728279 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-1ab66c27-8123-4ec4-b27b-d821a5723c69 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] [instance: be65ea57-bc8d-4bce-80c3-33d8b6007ed1] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:01:19.739914 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-1ab66c27-8123-4ec4-b27b-d821a5723c69 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:19.740386 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-1ab66c27-8123-4ec4-b27b-d821a5723c69 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:19.742714 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-1ab66c27-8123-4ec4-b27b-d821a5723c69 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:19.746503 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-1ab66c27-8123-4ec4-b27b-d821a5723c69 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:20.002253 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-1ab66c27-8123-4ec4-b27b-d821a5723c69 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] 10.222.0.47 "POST /compute/v2.1/servers/be65ea57-bc8d-4bce-80c3-33d8b6007ed1/action" status: 200 len: 17602 microversion: 2.1 time: 0.288325 Feb 19 05:01:20.011983 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 116/209] 10.222.0.47 () {60 vars in 1268 bytes} [Fri Feb 19 05:01:19 2021] POST /compute/v2.1/servers/be65ea57-bc8d-4bce-80c3-33d8b6007ed1/action => generated 17602 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 19 05:01:20.039222 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-11373cee-8157-455d-abd2-7a4176e93560 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:01:20.051315 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-11373cee-8157-455d-abd2-7a4176e93560 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] [instance: 798b77ff-c3ca-4c65-a120-db12ad953621] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:01:20.090994 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-11373cee-8157-455d-abd2-7a4176e93560 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:20.093004 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-11373cee-8157-455d-abd2-7a4176e93560 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:20.097558 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-11373cee-8157-455d-abd2-7a4176e93560 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:20.098923 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-11373cee-8157-455d-abd2-7a4176e93560 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:20.162830 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-df78fea3-dfc8-4ee5-8285-2234a88890ea tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24af0562e2aa43ca9d601be5e16fe9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ee9a43087d5497da3af9fbf68c4572d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:01:20.181318 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-df78fea3-dfc8-4ee5-8285-2234a88890ea tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] 10.222.0.47 "GET /compute/v2.1/servers/c74e760d-0b53-4508-ae21-494989132c3a" status: 200 len: 1521 microversion: 2.1 time: 1.002823 Feb 19 05:01:20.192318 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 94/210] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:01:19 2021] GET /compute/v2.1/servers/c74e760d-0b53-4508-ae21-494989132c3a => generated 1521 bytes in 1016 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 05:01:20.209857 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-9f44a6c5-c14f-440f-8bac-b0e6534c8524 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:01:20.210966 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-9f44a6c5-c14f-440f-8bac-b0e6534c8524 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] [instance: 3aafde29-2f77-4921-9580-05730dd73604] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:01:20.228320 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-9f44a6c5-c14f-440f-8bac-b0e6534c8524 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:20.229124 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-9f44a6c5-c14f-440f-8bac-b0e6534c8524 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:20.230589 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-9f44a6c5-c14f-440f-8bac-b0e6534c8524 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:20.232459 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-9f44a6c5-c14f-440f-8bac-b0e6534c8524 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:20.493476 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-9f44a6c5-c14f-440f-8bac-b0e6534c8524 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628d846121a14be78329ccc727c8869d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa473e12960449bbb0713a709e0abe4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:01:20.506625 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-9f44a6c5-c14f-440f-8bac-b0e6534c8524 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] 10.222.0.47 "GET /compute/v2.1/servers/3aafde29-2f77-4921-9580-05730dd73604" status: 200 len: 1276 microversion: 2.1 time: 0.312511 Feb 19 05:01:20.513763 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 95/211] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:01:20 2021] GET /compute/v2.1/servers/3aafde29-2f77-4921-9580-05730dd73604 => generated 1276 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:01:20.587063 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-11373cee-8157-455d-abd2-7a4176e93560 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] 10.222.0.47 "POST /compute/v2.1/servers/798b77ff-c3ca-4c65-a120-db12ad953621/action" status: 200 len: 28183 microversion: 2.20 time: 0.567446 Feb 19 05:01:20.588740 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 117/212] 10.222.0.47 () {62 vars in 1309 bytes} [Fri Feb 19 05:01:20 2021] POST /compute/v2.1/servers/798b77ff-c3ca-4c65-a120-db12ad953621/action => generated 28183 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 19 05:01:20.713582 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-b3c983d7-3223-4008-aab4-90c276440513 tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:01:20.714266 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-b3c983d7-3223-4008-aab4-90c276440513 tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] [instance: 65b5a76b-3d64-4b51-b955-04f6bdc76253] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:01:20.730479 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-b3c983d7-3223-4008-aab4-90c276440513 tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:20.730950 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-b3c983d7-3223-4008-aab4-90c276440513 tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:20.732056 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-b3c983d7-3223-4008-aab4-90c276440513 tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:20.733971 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-b3c983d7-3223-4008-aab4-90c276440513 tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:21.026740 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-12d63f2a-d80e-4601-946f-dae4788b643e tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:01:21.036462 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-12d63f2a-d80e-4601-946f-dae4788b643e tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] [instance: be65ea57-bc8d-4bce-80c3-33d8b6007ed1] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:01:21.112310 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-12d63f2a-d80e-4601-946f-dae4788b643e tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:21.115244 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-12d63f2a-d80e-4601-946f-dae4788b643e tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:21.116893 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-12d63f2a-d80e-4601-946f-dae4788b643e tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:21.117822 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-12d63f2a-d80e-4601-946f-dae4788b643e tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:21.441554 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-b3c983d7-3223-4008-aab4-90c276440513 tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ac58c346fa4d569782f22a3394e22a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f6827c056bf4dc0b68a527187f4be9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:01:21.469627 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-b3c983d7-3223-4008-aab4-90c276440513 tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] 10.222.0.47 "GET /compute/v2.1/servers/65b5a76b-3d64-4b51-b955-04f6bdc76253" status: 200 len: 1314 microversion: 2.1 time: 0.759645 Feb 19 05:01:21.471705 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 96/213] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:01:20 2021] GET /compute/v2.1/servers/65b5a76b-3d64-4b51-b955-04f6bdc76253 => generated 1314 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:01:21.487728 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-837adf00-b9f3-4f90-8372-7ebc3dbc5133 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:01:21.491893 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-837adf00-b9f3-4f90-8372-7ebc3dbc5133 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] [instance: c74e760d-0b53-4508-ae21-494989132c3a] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:01:21.529944 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-837adf00-b9f3-4f90-8372-7ebc3dbc5133 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:21.534024 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-837adf00-b9f3-4f90-8372-7ebc3dbc5133 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:21.539225 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-837adf00-b9f3-4f90-8372-7ebc3dbc5133 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:21.540475 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-837adf00-b9f3-4f90-8372-7ebc3dbc5133 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:21.549260 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-12d63f2a-d80e-4601-946f-dae4788b643e tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] 10.222.0.47 "POST /compute/v2.1/servers/be65ea57-bc8d-4bce-80c3-33d8b6007ed1/action" status: 200 len: 20193 microversion: 2.1 time: 0.532104 Feb 19 05:01:21.551740 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 118/214] 10.222.0.47 () {60 vars in 1268 bytes} [Fri Feb 19 05:01:21 2021] POST /compute/v2.1/servers/be65ea57-bc8d-4bce-80c3-33d8b6007ed1/action => generated 20193 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 19 05:01:21.575533 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-e7aff9f9-6456-4270-875e-9eb89bb07343 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:01:21.586468 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-e7aff9f9-6456-4270-875e-9eb89bb07343 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] [instance: 3aafde29-2f77-4921-9580-05730dd73604] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:01:21.623226 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-e7aff9f9-6456-4270-875e-9eb89bb07343 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:21.630036 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-e7aff9f9-6456-4270-875e-9eb89bb07343 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:21.632372 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-e7aff9f9-6456-4270-875e-9eb89bb07343 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:21.637002 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-e7aff9f9-6456-4270-875e-9eb89bb07343 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:22.643156 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-837adf00-b9f3-4f90-8372-7ebc3dbc5133 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24af0562e2aa43ca9d601be5e16fe9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ee9a43087d5497da3af9fbf68c4572d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:01:22.673139 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-837adf00-b9f3-4f90-8372-7ebc3dbc5133 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] 10.222.0.47 "GET /compute/v2.1/servers/c74e760d-0b53-4508-ae21-494989132c3a" status: 200 len: 1521 microversion: 2.1 time: 1.189063 Feb 19 05:01:22.676462 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 97/215] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:01:21 2021] GET /compute/v2.1/servers/c74e760d-0b53-4508-ae21-494989132c3a => generated 1521 bytes in 1202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:01:22.692599 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-3450e1c4-353e-4230-827f-dcb3589c5d31 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:01:22.695556 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-3450e1c4-353e-4230-827f-dcb3589c5d31 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] [instance: 798b77ff-c3ca-4c65-a120-db12ad953621] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:01:22.737427 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-3450e1c4-353e-4230-827f-dcb3589c5d31 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:22.739735 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-3450e1c4-353e-4230-827f-dcb3589c5d31 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:22.741695 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-3450e1c4-353e-4230-827f-dcb3589c5d31 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:22.743455 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-3450e1c4-353e-4230-827f-dcb3589c5d31 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:22.770000 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-e7aff9f9-6456-4270-875e-9eb89bb07343 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628d846121a14be78329ccc727c8869d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa473e12960449bbb0713a709e0abe4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:01:22.789078 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-e7aff9f9-6456-4270-875e-9eb89bb07343 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] 10.222.0.47 "GET /compute/v2.1/servers/3aafde29-2f77-4921-9580-05730dd73604" status: 200 len: 1318 microversion: 2.1 time: 1.235265 Feb 19 05:01:22.789709 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 119/216] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:01:21 2021] GET /compute/v2.1/servers/3aafde29-2f77-4921-9580-05730dd73604 => generated 1318 bytes in 1238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:01:22.795654 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [req-5af00b71-1efc-41ca-a16d-0ff92d212b5b req-d035b00b-f92b-4ee7-9b07-61bc9a3b153e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65b5a76b-3d64-4b51-b955-04f6bdc76253", "name": "network-vif-plugged", "status": "completed", "tag": "e233c19f-946c-4ce2-98af-3c1203421dda"}]} {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:01:22.797782 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 05:01:22.797782 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: warnings.warn(msg) Feb 19 05:01:22.817494 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [req-5af00b71-1efc-41ca-a16d-0ff92d212b5b req-d035b00b-f92b-4ee7-9b07-61bc9a3b153e service nova] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:22.821120 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [req-5af00b71-1efc-41ca-a16d-0ff92d212b5b req-d035b00b-f92b-4ee7-9b07-61bc9a3b153e service nova] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:22.866301 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.compute.server_external_events [req-5af00b71-1efc-41ca-a16d-0ff92d212b5b req-d035b00b-f92b-4ee7-9b07-61bc9a3b153e service nova] Creating event network-vif-plugged:e233c19f-946c-4ce2-98af-3c1203421dda for instance 65b5a76b-3d64-4b51-b955-04f6bdc76253 on hv-cinder-77642 Feb 19 05:01:22.876551 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [req-5af00b71-1efc-41ca-a16d-0ff92d212b5b req-d035b00b-f92b-4ee7-9b07-61bc9a3b153e service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085254 Feb 19 05:01:22.877492 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 120/217] 10.222.0.47 () {64 vars in 1308 bytes} [Fri Feb 19 05:01:22 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 05:01:22.884119 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-f1ea9828-e901-4ffa-a16e-0ab96c5f7c4b tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:01:22.885357 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-f1ea9828-e901-4ffa-a16e-0ab96c5f7c4b tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] [instance: 65b5a76b-3d64-4b51-b955-04f6bdc76253] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:01:22.895653 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-f1ea9828-e901-4ffa-a16e-0ab96c5f7c4b tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:22.896415 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-f1ea9828-e901-4ffa-a16e-0ab96c5f7c4b tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:22.897550 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-f1ea9828-e901-4ffa-a16e-0ab96c5f7c4b tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:22.898201 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-f1ea9828-e901-4ffa-a16e-0ab96c5f7c4b tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:23.027291 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-3450e1c4-353e-4230-827f-dcb3589c5d31 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] 10.222.0.47 "POST /compute/v2.1/servers/798b77ff-c3ca-4c65-a120-db12ad953621/action" status: 200 len: 28473 microversion: 2.20 time: 0.348290 Feb 19 05:01:23.029725 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 98/218] 10.222.0.47 () {62 vars in 1309 bytes} [Fri Feb 19 05:01:22 2021] POST /compute/v2.1/servers/798b77ff-c3ca-4c65-a120-db12ad953621/action => generated 28473 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 19 05:01:23.063060 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-372be1d4-5441-43ba-aeb8-b8ee796b52ad tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:01:23.070244 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-372be1d4-5441-43ba-aeb8-b8ee796b52ad tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] [instance: be65ea57-bc8d-4bce-80c3-33d8b6007ed1] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:01:23.126693 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-372be1d4-5441-43ba-aeb8-b8ee796b52ad tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:23.127871 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-372be1d4-5441-43ba-aeb8-b8ee796b52ad tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:23.129790 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-372be1d4-5441-43ba-aeb8-b8ee796b52ad tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:23.130902 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-372be1d4-5441-43ba-aeb8-b8ee796b52ad tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:23.315366 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-f1ea9828-e901-4ffa-a16e-0ab96c5f7c4b tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ac58c346fa4d569782f22a3394e22a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f6827c056bf4dc0b68a527187f4be9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:01:23.346052 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-f1ea9828-e901-4ffa-a16e-0ab96c5f7c4b tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] 10.222.0.47 "GET /compute/v2.1/servers/65b5a76b-3d64-4b51-b955-04f6bdc76253" status: 200 len: 1314 microversion: 2.1 time: 0.466324 Feb 19 05:01:23.347219 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 121/219] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:01:22 2021] GET /compute/v2.1/servers/65b5a76b-3d64-4b51-b955-04f6bdc76253 => generated 1314 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:01:23.435913 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-372be1d4-5441-43ba-aeb8-b8ee796b52ad tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] 10.222.0.47 "POST /compute/v2.1/servers/be65ea57-bc8d-4bce-80c3-33d8b6007ed1/action" status: 200 len: 22886 microversion: 2.1 time: 0.404346 Feb 19 05:01:23.437116 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 99/220] 10.222.0.47 () {60 vars in 1268 bytes} [Fri Feb 19 05:01:23 2021] POST /compute/v2.1/servers/be65ea57-bc8d-4bce-80c3-33d8b6007ed1/action => generated 22886 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 19 05:01:23.698316 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-b508b72e-0aa5-4c00-8d65-4ab8d7d51837 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:01:23.700397 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-b508b72e-0aa5-4c00-8d65-4ab8d7d51837 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] [instance: c74e760d-0b53-4508-ae21-494989132c3a] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:01:23.712656 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-b508b72e-0aa5-4c00-8d65-4ab8d7d51837 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:23.713538 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-b508b72e-0aa5-4c00-8d65-4ab8d7d51837 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:23.714664 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-b508b72e-0aa5-4c00-8d65-4ab8d7d51837 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:23.715719 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-b508b72e-0aa5-4c00-8d65-4ab8d7d51837 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:23.825664 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-ea19a3d3-ddc5-41fd-9958-ed0f3e3b38d3 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:01:23.827916 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-ea19a3d3-ddc5-41fd-9958-ed0f3e3b38d3 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] [instance: 3aafde29-2f77-4921-9580-05730dd73604] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:01:23.894972 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-ea19a3d3-ddc5-41fd-9958-ed0f3e3b38d3 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:23.896917 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-ea19a3d3-ddc5-41fd-9958-ed0f3e3b38d3 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:23.902474 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-ea19a3d3-ddc5-41fd-9958-ed0f3e3b38d3 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:23.904558 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-ea19a3d3-ddc5-41fd-9958-ed0f3e3b38d3 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:24.353234 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-b508b72e-0aa5-4c00-8d65-4ab8d7d51837 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24af0562e2aa43ca9d601be5e16fe9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ee9a43087d5497da3af9fbf68c4572d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:01:24.400647 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-b508b72e-0aa5-4c00-8d65-4ab8d7d51837 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] 10.222.0.47 "GET /compute/v2.1/servers/c74e760d-0b53-4508-ae21-494989132c3a" status: 200 len: 1521 microversion: 2.1 time: 0.709269 Feb 19 05:01:24.407159 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 122/221] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:01:23 2021] GET /compute/v2.1/servers/c74e760d-0b53-4508-ae21-494989132c3a => generated 1521 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:01:24.420263 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-ba222cef-4ada-4e6f-9405-24e6fe6af0c0 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:01:24.423149 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-ba222cef-4ada-4e6f-9405-24e6fe6af0c0 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] [instance: 798b77ff-c3ca-4c65-a120-db12ad953621] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:01:24.452569 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-ba222cef-4ada-4e6f-9405-24e6fe6af0c0 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:24.454110 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-ba222cef-4ada-4e6f-9405-24e6fe6af0c0 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:24.463611 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-ba222cef-4ada-4e6f-9405-24e6fe6af0c0 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:24.473373 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-ba222cef-4ada-4e6f-9405-24e6fe6af0c0 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:24.513014 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-ea19a3d3-ddc5-41fd-9958-ed0f3e3b38d3 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628d846121a14be78329ccc727c8869d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa473e12960449bbb0713a709e0abe4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:01:24.526055 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-ea19a3d3-ddc5-41fd-9958-ed0f3e3b38d3 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] 10.222.0.47 "GET /compute/v2.1/servers/3aafde29-2f77-4921-9580-05730dd73604" status: 200 len: 1318 microversion: 2.1 time: 0.719675 Feb 19 05:01:24.526683 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 100/222] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:01:23 2021] GET /compute/v2.1/servers/3aafde29-2f77-4921-9580-05730dd73604 => generated 1318 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:01:24.532106 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-d635c0cd-4db7-4421-96f0-b2974bdd6198 tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:01:24.533023 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-d635c0cd-4db7-4421-96f0-b2974bdd6198 tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] [instance: 65b5a76b-3d64-4b51-b955-04f6bdc76253] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:01:24.559971 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-d635c0cd-4db7-4421-96f0-b2974bdd6198 tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:24.560879 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-d635c0cd-4db7-4421-96f0-b2974bdd6198 tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:24.562366 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-d635c0cd-4db7-4421-96f0-b2974bdd6198 tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:24.563053 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-d635c0cd-4db7-4421-96f0-b2974bdd6198 tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:24.995658 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-d635c0cd-4db7-4421-96f0-b2974bdd6198 tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ac58c346fa4d569782f22a3394e22a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f6827c056bf4dc0b68a527187f4be9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:01:25.010810 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-d635c0cd-4db7-4421-96f0-b2974bdd6198 tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] 10.222.0.47 "GET /compute/v2.1/servers/65b5a76b-3d64-4b51-b955-04f6bdc76253" status: 200 len: 1314 microversion: 2.1 time: 0.482641 Feb 19 05:01:25.015542 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 101/223] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:01:24 2021] GET /compute/v2.1/servers/65b5a76b-3d64-4b51-b955-04f6bdc76253 => generated 1314 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:01:25.024205 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-a93edbfe-8722-4297-8e35-c9a6da9e5046 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:01:25.025946 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-a93edbfe-8722-4297-8e35-c9a6da9e5046 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] [instance: be65ea57-bc8d-4bce-80c3-33d8b6007ed1] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:01:25.053184 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-a93edbfe-8722-4297-8e35-c9a6da9e5046 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:25.054160 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-a93edbfe-8722-4297-8e35-c9a6da9e5046 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:25.055903 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-a93edbfe-8722-4297-8e35-c9a6da9e5046 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:25.056575 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-a93edbfe-8722-4297-8e35-c9a6da9e5046 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:27.207978 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-ba222cef-4ada-4e6f-9405-24e6fe6af0c0 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] 10.222.0.47 "POST /compute/v2.1/servers/798b77ff-c3ca-4c65-a120-db12ad953621/action" status: 200 len: 28640 microversion: 2.20 time: 2.797474 Feb 19 05:01:27.209084 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 123/224] 10.222.0.47 () {62 vars in 1309 bytes} [Fri Feb 19 05:01:24 2021] POST /compute/v2.1/servers/798b77ff-c3ca-4c65-a120-db12ad953621/action => generated 28640 bytes in 2801 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 19 05:01:27.219632 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [req-46e19954-da2d-48f4-bb08-06879cb8301e req-f8147dac-3d38-4e33-8821-54ffc4922443 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3aafde29-2f77-4921-9580-05730dd73604", "tag": "bcb6d6a6-4ff3-4e7d-abec-293ccd22f45b"}]} {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:01:27.223820 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 05:01:27.223820 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: warnings.warn(msg) Feb 19 05:01:27.242362 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [req-46e19954-da2d-48f4-bb08-06879cb8301e req-f8147dac-3d38-4e33-8821-54ffc4922443 service nova] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:27.243450 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [req-46e19954-da2d-48f4-bb08-06879cb8301e req-f8147dac-3d38-4e33-8821-54ffc4922443 service nova] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:27.245190 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-a93edbfe-8722-4297-8e35-c9a6da9e5046 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] 10.222.0.47 "POST /compute/v2.1/servers/be65ea57-bc8d-4bce-80c3-33d8b6007ed1/action" status: 200 len: 26221 microversion: 2.1 time: 2.227812 Feb 19 05:01:27.252778 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 102/225] 10.222.0.47 () {60 vars in 1268 bytes} [Fri Feb 19 05:01:25 2021] POST /compute/v2.1/servers/be65ea57-bc8d-4bce-80c3-33d8b6007ed1/action => generated 26221 bytes in 2230 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 19 05:01:27.271601 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-dbfbca31-2f94-4e69-a16b-cba6ad1c15fc tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:01:27.272938 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-dbfbca31-2f94-4e69-a16b-cba6ad1c15fc tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] [instance: c74e760d-0b53-4508-ae21-494989132c3a] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:01:27.290990 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.compute.server_external_events [req-46e19954-da2d-48f4-bb08-06879cb8301e req-f8147dac-3d38-4e33-8821-54ffc4922443 service nova] Creating event network-changed:bcb6d6a6-4ff3-4e7d-abec-293ccd22f45b for instance 3aafde29-2f77-4921-9580-05730dd73604 on hv-cinder-77642 Feb 19 05:01:27.296873 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [req-46e19954-da2d-48f4-bb08-06879cb8301e req-f8147dac-3d38-4e33-8821-54ffc4922443 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085827 Feb 19 05:01:27.297767 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 124/226] 10.222.0.47 () {64 vars in 1308 bytes} [Fri Feb 19 05:01:27 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 05:01:27.298484 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-dbfbca31-2f94-4e69-a16b-cba6ad1c15fc tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:27.299875 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-dbfbca31-2f94-4e69-a16b-cba6ad1c15fc tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:27.302188 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-dbfbca31-2f94-4e69-a16b-cba6ad1c15fc tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:27.303234 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-dbfbca31-2f94-4e69-a16b-cba6ad1c15fc tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:27.305476 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-8a38abb5-d184-4759-9770-b1115a1d080f tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:01:27.306551 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-8a38abb5-d184-4759-9770-b1115a1d080f tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] [instance: 3aafde29-2f77-4921-9580-05730dd73604] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:01:27.315916 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-8a38abb5-d184-4759-9770-b1115a1d080f tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:27.317096 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-8a38abb5-d184-4759-9770-b1115a1d080f tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:27.318407 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-8a38abb5-d184-4759-9770-b1115a1d080f tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:27.319132 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-8a38abb5-d184-4759-9770-b1115a1d080f tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:27.750228 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-8a38abb5-d184-4759-9770-b1115a1d080f tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628d846121a14be78329ccc727c8869d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa473e12960449bbb0713a709e0abe4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:01:27.763572 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-dbfbca31-2f94-4e69-a16b-cba6ad1c15fc tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24af0562e2aa43ca9d601be5e16fe9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ee9a43087d5497da3af9fbf68c4572d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:01:27.773092 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-8a38abb5-d184-4759-9770-b1115a1d080f tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] 10.222.0.47 "GET /compute/v2.1/servers/3aafde29-2f77-4921-9580-05730dd73604" status: 200 len: 1318 microversion: 2.1 time: 0.473903 Feb 19 05:01:27.774117 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 125/227] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:01:27 2021] GET /compute/v2.1/servers/3aafde29-2f77-4921-9580-05730dd73604 => generated 1318 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:01:27.780340 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-8a947e69-f61c-4863-965a-1651a4fced4f tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:01:27.781940 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-8a947e69-f61c-4863-965a-1651a4fced4f tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] [instance: 65b5a76b-3d64-4b51-b955-04f6bdc76253] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:01:27.787109 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-dbfbca31-2f94-4e69-a16b-cba6ad1c15fc tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] 10.222.0.47 "GET /compute/v2.1/servers/c74e760d-0b53-4508-ae21-494989132c3a" status: 200 len: 1521 microversion: 2.1 time: 0.537030 Feb 19 05:01:27.788908 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 103/228] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:01:27 2021] GET /compute/v2.1/servers/c74e760d-0b53-4508-ae21-494989132c3a => generated 1521 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:01:27.793267 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-8a947e69-f61c-4863-965a-1651a4fced4f tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:27.793913 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-8a947e69-f61c-4863-965a-1651a4fced4f tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:27.794890 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-8a947e69-f61c-4863-965a-1651a4fced4f tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:27.795570 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-8a947e69-f61c-4863-965a-1651a4fced4f tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:28.201150 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-8a947e69-f61c-4863-965a-1651a4fced4f tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ac58c346fa4d569782f22a3394e22a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f6827c056bf4dc0b68a527187f4be9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:01:28.221351 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-8a947e69-f61c-4863-965a-1651a4fced4f tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] 10.222.0.47 "GET /compute/v2.1/servers/65b5a76b-3d64-4b51-b955-04f6bdc76253" status: 200 len: 1314 microversion: 2.1 time: 0.444697 Feb 19 05:01:28.222997 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 126/229] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:01:27 2021] GET /compute/v2.1/servers/65b5a76b-3d64-4b51-b955-04f6bdc76253 => generated 1314 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:01:28.224126 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-46cf9da7-9aef-4000-9bae-62df664a830d tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:01:28.225669 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-46cf9da7-9aef-4000-9bae-62df664a830d tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] [instance: 798b77ff-c3ca-4c65-a120-db12ad953621] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:01:28.235118 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-46cf9da7-9aef-4000-9bae-62df664a830d tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:28.235994 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-46cf9da7-9aef-4000-9bae-62df664a830d tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:28.237064 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-46cf9da7-9aef-4000-9bae-62df664a830d tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:28.237746 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-46cf9da7-9aef-4000-9bae-62df664a830d tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:28.266094 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-d84465ac-6f98-4655-83e4-514d5b6c4aa6 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:01:28.268459 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-d84465ac-6f98-4655-83e4-514d5b6c4aa6 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] [instance: be65ea57-bc8d-4bce-80c3-33d8b6007ed1] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:01:28.284489 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-d84465ac-6f98-4655-83e4-514d5b6c4aa6 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:28.286015 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-d84465ac-6f98-4655-83e4-514d5b6c4aa6 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:28.288084 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-d84465ac-6f98-4655-83e4-514d5b6c4aa6 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:28.289110 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-d84465ac-6f98-4655-83e4-514d5b6c4aa6 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:28.412950 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-46cf9da7-9aef-4000-9bae-62df664a830d tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] 10.222.0.47 "POST /compute/v2.1/servers/798b77ff-c3ca-4c65-a120-db12ad953621/action" status: 200 len: 28640 microversion: 2.20 time: 0.192894 Feb 19 05:01:28.422635 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 104/230] 10.222.0.47 () {62 vars in 1309 bytes} [Fri Feb 19 05:01:28 2021] POST /compute/v2.1/servers/798b77ff-c3ca-4c65-a120-db12ad953621/action => generated 28640 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Feb 19 05:01:28.539716 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-d84465ac-6f98-4655-83e4-514d5b6c4aa6 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] 10.222.0.47 "POST /compute/v2.1/servers/be65ea57-bc8d-4bce-80c3-33d8b6007ed1/action" status: 200 len: 26991 microversion: 2.1 time: 0.278788 Feb 19 05:01:28.539716 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 127/231] 10.222.0.47 () {60 vars in 1268 bytes} [Fri Feb 19 05:01:28 2021] POST /compute/v2.1/servers/be65ea57-bc8d-4bce-80c3-33d8b6007ed1/action => generated 26991 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 19 05:01:28.808223 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-e3483fa5-94c4-4d39-b1b5-42c2ebfdafa8 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:01:28.809810 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-e3483fa5-94c4-4d39-b1b5-42c2ebfdafa8 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] [instance: 3aafde29-2f77-4921-9580-05730dd73604] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:01:28.827972 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-04844400-bcfb-4358-a338-13ef21139174 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:01:28.829476 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-04844400-bcfb-4358-a338-13ef21139174 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] [instance: c74e760d-0b53-4508-ae21-494989132c3a] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:01:28.861750 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-e3483fa5-94c4-4d39-b1b5-42c2ebfdafa8 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:28.862695 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-e3483fa5-94c4-4d39-b1b5-42c2ebfdafa8 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:28.864411 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-e3483fa5-94c4-4d39-b1b5-42c2ebfdafa8 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:28.865301 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-e3483fa5-94c4-4d39-b1b5-42c2ebfdafa8 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:28.868965 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-04844400-bcfb-4358-a338-13ef21139174 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:28.869524 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-04844400-bcfb-4358-a338-13ef21139174 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:28.870440 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-04844400-bcfb-4358-a338-13ef21139174 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:28.871629 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-04844400-bcfb-4358-a338-13ef21139174 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:29.582198 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-04844400-bcfb-4358-a338-13ef21139174 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24af0562e2aa43ca9d601be5e16fe9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ee9a43087d5497da3af9fbf68c4572d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:01:29.598231 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-e3483fa5-94c4-4d39-b1b5-42c2ebfdafa8 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628d846121a14be78329ccc727c8869d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa473e12960449bbb0713a709e0abe4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:01:29.614090 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-04844400-bcfb-4358-a338-13ef21139174 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] 10.222.0.47 "GET /compute/v2.1/servers/c74e760d-0b53-4508-ae21-494989132c3a" status: 200 len: 1521 microversion: 2.1 time: 0.798032 Feb 19 05:01:29.616154 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 128/232] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:01:28 2021] GET /compute/v2.1/servers/c74e760d-0b53-4508-ae21-494989132c3a => generated 1521 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:01:29.617149 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-e3483fa5-94c4-4d39-b1b5-42c2ebfdafa8 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] 10.222.0.47 "GET /compute/v2.1/servers/3aafde29-2f77-4921-9580-05730dd73604" status: 200 len: 1318 microversion: 2.1 time: 0.818731 Feb 19 05:01:29.638313 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 105/233] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:01:28 2021] GET /compute/v2.1/servers/3aafde29-2f77-4921-9580-05730dd73604 => generated 1318 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:01:29.644521 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-fcc6658b-7663-473b-ba42-15b64678145d tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:01:29.646963 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-d4750ee1-88d4-4e8a-b6b7-9a6d350174de tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:01:29.647936 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-d4750ee1-88d4-4e8a-b6b7-9a6d350174de tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] [instance: 65b5a76b-3d64-4b51-b955-04f6bdc76253] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:01:29.652861 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-fcc6658b-7663-473b-ba42-15b64678145d tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] [instance: 798b77ff-c3ca-4c65-a120-db12ad953621] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:01:29.666654 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-d4750ee1-88d4-4e8a-b6b7-9a6d350174de tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:29.668539 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-fcc6658b-7663-473b-ba42-15b64678145d tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:29.669330 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-d4750ee1-88d4-4e8a-b6b7-9a6d350174de tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:29.670401 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-d4750ee1-88d4-4e8a-b6b7-9a6d350174de tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:29.670889 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-d4750ee1-88d4-4e8a-b6b7-9a6d350174de tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:29.671957 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-fcc6658b-7663-473b-ba42-15b64678145d tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:29.672808 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-fcc6658b-7663-473b-ba42-15b64678145d tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:29.674189 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-fcc6658b-7663-473b-ba42-15b64678145d tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:30.067069 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-d4750ee1-88d4-4e8a-b6b7-9a6d350174de tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ac58c346fa4d569782f22a3394e22a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f6827c056bf4dc0b68a527187f4be9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:01:30.083622 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-d4750ee1-88d4-4e8a-b6b7-9a6d350174de tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] 10.222.0.47 "GET /compute/v2.1/servers/65b5a76b-3d64-4b51-b955-04f6bdc76253" status: 200 len: 1497 microversion: 2.1 time: 0.464747 Feb 19 05:01:30.084678 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 129/234] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:01:29 2021] GET /compute/v2.1/servers/65b5a76b-3d64-4b51-b955-04f6bdc76253 => generated 1497 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:01:30.093542 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-950299dd-5da8-4345-ac0d-69d887288ba9 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:01:30.095295 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-950299dd-5da8-4345-ac0d-69d887288ba9 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] [instance: be65ea57-bc8d-4bce-80c3-33d8b6007ed1] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:01:30.111071 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-950299dd-5da8-4345-ac0d-69d887288ba9 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:30.111945 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-950299dd-5da8-4345-ac0d-69d887288ba9 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:30.113462 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-950299dd-5da8-4345-ac0d-69d887288ba9 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:30.114290 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-950299dd-5da8-4345-ac0d-69d887288ba9 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:32.560190 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-fcc6658b-7663-473b-ba42-15b64678145d tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] 10.222.0.47 "POST /compute/v2.1/servers/798b77ff-c3ca-4c65-a120-db12ad953621/action" status: 200 len: 28640 microversion: 2.20 time: 2.919988 Feb 19 05:01:32.560915 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 106/235] 10.222.0.47 () {62 vars in 1309 bytes} [Fri Feb 19 05:01:29 2021] POST /compute/v2.1/servers/798b77ff-c3ca-4c65-a120-db12ad953621/action => generated 28640 bytes in 2922 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 19 05:01:32.571511 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-3a32a5de-df22-4870-8b1c-f6d4971b096c tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:01:32.573599 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-3a32a5de-df22-4870-8b1c-f6d4971b096c tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] [instance: 3aafde29-2f77-4921-9580-05730dd73604] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:01:32.584748 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-3a32a5de-df22-4870-8b1c-f6d4971b096c tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:32.585607 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-3a32a5de-df22-4870-8b1c-f6d4971b096c tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:32.586711 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-3a32a5de-df22-4870-8b1c-f6d4971b096c tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:32.587465 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-3a32a5de-df22-4870-8b1c-f6d4971b096c tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:32.616166 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-950299dd-5da8-4345-ac0d-69d887288ba9 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] 10.222.0.47 "POST /compute/v2.1/servers/be65ea57-bc8d-4bce-80c3-33d8b6007ed1/action" status: 200 len: 27797 microversion: 2.1 time: 2.528208 Feb 19 05:01:32.617216 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 130/236] 10.222.0.47 () {60 vars in 1268 bytes} [Fri Feb 19 05:01:30 2021] POST /compute/v2.1/servers/be65ea57-bc8d-4bce-80c3-33d8b6007ed1/action => generated 27797 bytes in 2532 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 19 05:01:32.652096 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-0194bb40-d1f8-42a8-9bd8-8030438cb290 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:01:32.653439 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-0194bb40-d1f8-42a8-9bd8-8030438cb290 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] [instance: c74e760d-0b53-4508-ae21-494989132c3a] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:01:32.696702 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-0194bb40-d1f8-42a8-9bd8-8030438cb290 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:32.698130 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-0194bb40-d1f8-42a8-9bd8-8030438cb290 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:32.699923 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-0194bb40-d1f8-42a8-9bd8-8030438cb290 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:32.700269 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-0194bb40-d1f8-42a8-9bd8-8030438cb290 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:33.397587 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-3a32a5de-df22-4870-8b1c-f6d4971b096c tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628d846121a14be78329ccc727c8869d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa473e12960449bbb0713a709e0abe4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:01:33.438470 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-3a32a5de-df22-4870-8b1c-f6d4971b096c tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] 10.222.0.47 "GET /compute/v2.1/servers/3aafde29-2f77-4921-9580-05730dd73604" status: 200 len: 1318 microversion: 2.1 time: 0.872007 Feb 19 05:01:33.442860 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 107/237] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:01:32 2021] GET /compute/v2.1/servers/3aafde29-2f77-4921-9580-05730dd73604 => generated 1318 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:01:33.506884 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-0194bb40-d1f8-42a8-9bd8-8030438cb290 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24af0562e2aa43ca9d601be5e16fe9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ee9a43087d5497da3af9fbf68c4572d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:01:33.533870 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-0194bb40-d1f8-42a8-9bd8-8030438cb290 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] 10.222.0.47 "GET /compute/v2.1/servers/c74e760d-0b53-4508-ae21-494989132c3a" status: 200 len: 1501 microversion: 2.1 time: 0.905077 Feb 19 05:01:33.541611 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 131/238] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:01:32 2021] GET /compute/v2.1/servers/c74e760d-0b53-4508-ae21-494989132c3a => generated 1501 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:01:33.584475 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-ed404305-2e39-4342-beed-5043bed374b7 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:01:33.586277 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-ed404305-2e39-4342-beed-5043bed374b7 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] [instance: 798b77ff-c3ca-4c65-a120-db12ad953621] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:01:33.589182 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-b8ce57bd-18f8-4a21-8834-25bee2a29f30 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:01:33.594715 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-b8ce57bd-18f8-4a21-8834-25bee2a29f30 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] [instance: 74c5a115-b174-49fe-9b75-574e484a09e2] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:01:33.626451 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-ed404305-2e39-4342-beed-5043bed374b7 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:33.627353 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-ed404305-2e39-4342-beed-5043bed374b7 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:33.628902 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-ed404305-2e39-4342-beed-5043bed374b7 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:33.630029 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-ed404305-2e39-4342-beed-5043bed374b7 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:33.668492 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-b8ce57bd-18f8-4a21-8834-25bee2a29f30 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:33.677450 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-b8ce57bd-18f8-4a21-8834-25bee2a29f30 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:33.679477 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-b8ce57bd-18f8-4a21-8834-25bee2a29f30 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:33.684215 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-b8ce57bd-18f8-4a21-8834-25bee2a29f30 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:34.016518 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-ed404305-2e39-4342-beed-5043bed374b7 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] 10.222.0.47 "POST /compute/v2.1/servers/798b77ff-c3ca-4c65-a120-db12ad953621/action" status: 200 len: 28640 microversion: 2.20 time: 0.441681 Feb 19 05:01:34.018200 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 108/239] 10.222.0.47 () {62 vars in 1309 bytes} [Fri Feb 19 05:01:33 2021] POST /compute/v2.1/servers/798b77ff-c3ca-4c65-a120-db12ad953621/action => generated 28640 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 19 05:01:34.053327 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-e2e99099-f151-436e-b535-0f68c743d96d tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:01:34.072688 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-e2e99099-f151-436e-b535-0f68c743d96d tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] [instance: be65ea57-bc8d-4bce-80c3-33d8b6007ed1] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:01:34.100579 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-e2e99099-f151-436e-b535-0f68c743d96d tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:34.101473 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-e2e99099-f151-436e-b535-0f68c743d96d tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:34.103238 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-e2e99099-f151-436e-b535-0f68c743d96d tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:34.104186 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-e2e99099-f151-436e-b535-0f68c743d96d tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:34.342653 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-e2e99099-f151-436e-b535-0f68c743d96d tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] 10.222.0.47 "POST /compute/v2.1/servers/be65ea57-bc8d-4bce-80c3-33d8b6007ed1/action" status: 200 len: 28159 microversion: 2.1 time: 0.320867 Feb 19 05:01:34.344772 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 109/240] 10.222.0.47 () {60 vars in 1268 bytes} [Fri Feb 19 05:01:34 2021] POST /compute/v2.1/servers/be65ea57-bc8d-4bce-80c3-33d8b6007ed1/action => generated 28159 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 19 05:01:34.373711 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-b8ce57bd-18f8-4a21-8834-25bee2a29f30 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24af0562e2aa43ca9d601be5e16fe9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ee9a43087d5497da3af9fbf68c4572d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:01:34.386162 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-b8ce57bd-18f8-4a21-8834-25bee2a29f30 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] 10.222.0.47 "GET /compute/v2.1/servers/74c5a115-b174-49fe-9b75-574e484a09e2" status: 200 len: 1513 microversion: 2.1 time: 0.814650 Feb 19 05:01:34.387231 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 132/241] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:01:33 2021] GET /compute/v2.1/servers/74c5a115-b174-49fe-9b75-574e484a09e2 => generated 1513 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:01:34.475514 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-a4b46ff5-dfc7-490b-9b00-d6ba4b1ad1ee tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:01:34.476314 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-a4b46ff5-dfc7-490b-9b00-d6ba4b1ad1ee tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] [instance: 3aafde29-2f77-4921-9580-05730dd73604] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:01:34.487493 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-a4b46ff5-dfc7-490b-9b00-d6ba4b1ad1ee tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:34.488721 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-a4b46ff5-dfc7-490b-9b00-d6ba4b1ad1ee tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:34.489684 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-a4b46ff5-dfc7-490b-9b00-d6ba4b1ad1ee tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:34.490184 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-a4b46ff5-dfc7-490b-9b00-d6ba4b1ad1ee tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:34.771106 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-a4b46ff5-dfc7-490b-9b00-d6ba4b1ad1ee tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628d846121a14be78329ccc727c8869d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa473e12960449bbb0713a709e0abe4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:01:34.791247 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-a4b46ff5-dfc7-490b-9b00-d6ba4b1ad1ee tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] 10.222.0.47 "GET /compute/v2.1/servers/3aafde29-2f77-4921-9580-05730dd73604" status: 200 len: 1318 microversion: 2.1 time: 0.319552 Feb 19 05:01:34.792078 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 110/242] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:01:34 2021] GET /compute/v2.1/servers/3aafde29-2f77-4921-9580-05730dd73604 => generated 1318 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:01:35.036233 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-9c25a856-f136-44d9-872e-fe79427cdac3 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:01:35.037778 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-9c25a856-f136-44d9-872e-fe79427cdac3 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] [instance: 798b77ff-c3ca-4c65-a120-db12ad953621] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:01:35.052655 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-9c25a856-f136-44d9-872e-fe79427cdac3 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:35.053425 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-9c25a856-f136-44d9-872e-fe79427cdac3 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:35.054857 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-9c25a856-f136-44d9-872e-fe79427cdac3 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:35.056000 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-9c25a856-f136-44d9-872e-fe79427cdac3 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:35.275213 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-9c25a856-f136-44d9-872e-fe79427cdac3 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] 10.222.0.47 "POST /compute/v2.1/servers/798b77ff-c3ca-4c65-a120-db12ad953621/action" status: 200 len: 28640 microversion: 2.20 time: 0.238806 Feb 19 05:01:35.276778 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 133/243] 10.222.0.47 () {62 vars in 1309 bytes} [Fri Feb 19 05:01:35 2021] POST /compute/v2.1/servers/798b77ff-c3ca-4c65-a120-db12ad953621/action => generated 28640 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 19 05:01:35.349628 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-b9ca9bcc-d8df-4c40-a309-988680296a80 tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:01:35.350408 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-b9ca9bcc-d8df-4c40-a309-988680296a80 tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] [instance: 65b5a76b-3d64-4b51-b955-04f6bdc76253] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:01:35.359437 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-b9ca9bcc-d8df-4c40-a309-988680296a80 tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:35.360183 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-b9ca9bcc-d8df-4c40-a309-988680296a80 tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:35.361217 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-b9ca9bcc-d8df-4c40-a309-988680296a80 tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:35.361862 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-b9ca9bcc-d8df-4c40-a309-988680296a80 tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:35.364422 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-beaebe4c-11bc-4574-be39-a50ceb325bf5 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:01:35.366544 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-beaebe4c-11bc-4574-be39-a50ceb325bf5 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] [instance: be65ea57-bc8d-4bce-80c3-33d8b6007ed1] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:01:35.409136 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-beaebe4c-11bc-4574-be39-a50ceb325bf5 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:35.410087 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-beaebe4c-11bc-4574-be39-a50ceb325bf5 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:35.411668 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-beaebe4c-11bc-4574-be39-a50ceb325bf5 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:35.412560 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-beaebe4c-11bc-4574-be39-a50ceb325bf5 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:35.439568 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-b9ca9bcc-d8df-4c40-a309-988680296a80 tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] [instance: 65b5a76b-3d64-4b51-b955-04f6bdc76253] Going to try to terminate instance {{(pid=98153) delete /opt/stack/nova/nova/compute/api.py:2540}} Feb 19 05:01:35.645059 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-b9ca9bcc-d8df-4c40-a309-988680296a80 tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] 10.222.0.47 "DELETE /compute/v2.1/servers/65b5a76b-3d64-4b51-b955-04f6bdc76253" status: 204 len: 0 microversion: 2.1 time: 0.298439 Feb 19 05:01:35.646537 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 111/244] 10.222.0.47 () {58 vars in 1229 bytes} [Fri Feb 19 05:01:35 2021] DELETE /compute/v2.1/servers/65b5a76b-3d64-4b51-b955-04f6bdc76253 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 19 05:01:35.655041 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-beaebe4c-11bc-4574-be39-a50ceb325bf5 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] 10.222.0.47 "POST /compute/v2.1/servers/be65ea57-bc8d-4bce-80c3-33d8b6007ed1/action" status: 200 len: 28159 microversion: 2.1 time: 0.301029 Feb 19 05:01:35.656025 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 134/245] 10.222.0.47 () {60 vars in 1268 bytes} [Fri Feb 19 05:01:35 2021] POST /compute/v2.1/servers/be65ea57-bc8d-4bce-80c3-33d8b6007ed1/action => generated 28159 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 19 05:01:35.662200 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-8ba55c44-946b-496d-a6d6-74b027d89f92 tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:01:35.663975 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-8ba55c44-946b-496d-a6d6-74b027d89f92 tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] [instance: 65b5a76b-3d64-4b51-b955-04f6bdc76253] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:01:35.672970 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-bc0a10a8-940a-4d30-959b-613368d159a5 tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-679685744", "imageRef": "53cdf9de-e495-4ca8-845f-6be2bf32cecb", "flavorRef": "452", "networks": [{"uuid": "cbdeecea-e92c-4ac9-9254-261e63b55f49"}]}} {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:01:35.673914 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-8ba55c44-946b-496d-a6d6-74b027d89f92 tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:35.674989 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-8ba55c44-946b-496d-a6d6-74b027d89f92 tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:35.676259 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-8ba55c44-946b-496d-a6d6-74b027d89f92 tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:35.677116 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-8ba55c44-946b-496d-a6d6-74b027d89f92 tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:35.810250 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.network.neutron [None req-bc0a10a8-940a-4d30-959b-613368d159a5 tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] validate_networks() for [('cbdeecea-e92c-4ac9-9254-261e63b55f49', None, None, None)] {{(pid=98153) validate_networks /opt/stack/nova/nova/network/neutron.py:2345}} Feb 19 05:01:36.156103 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-8ba55c44-946b-496d-a6d6-74b027d89f92 tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ac58c346fa4d569782f22a3394e22a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f6827c056bf4dc0b68a527187f4be9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:01:36.173621 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-8ba55c44-946b-496d-a6d6-74b027d89f92 tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] 10.222.0.47 "GET /compute/v2.1/servers/65b5a76b-3d64-4b51-b955-04f6bdc76253" status: 200 len: 1503 microversion: 2.1 time: 0.516068 Feb 19 05:01:36.174297 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 135/246] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:01:35 2021] GET /compute/v2.1/servers/65b5a76b-3d64-4b51-b955-04f6bdc76253 => generated 1503 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:01:36.180708 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-4580020b-6207-4e0e-bac3-86e15bcc5bae tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:01:36.181395 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-4580020b-6207-4e0e-bac3-86e15bcc5bae tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] [instance: 3aafde29-2f77-4921-9580-05730dd73604] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:01:36.189785 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-4580020b-6207-4e0e-bac3-86e15bcc5bae tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:36.190304 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-4580020b-6207-4e0e-bac3-86e15bcc5bae tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:36.191863 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-4580020b-6207-4e0e-bac3-86e15bcc5bae tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:36.192389 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-4580020b-6207-4e0e-bac3-86e15bcc5bae tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:36.713599 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-4580020b-6207-4e0e-bac3-86e15bcc5bae tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628d846121a14be78329ccc727c8869d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa473e12960449bbb0713a709e0abe4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:01:36.730497 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-4580020b-6207-4e0e-bac3-86e15bcc5bae tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] 10.222.0.47 "GET /compute/v2.1/servers/3aafde29-2f77-4921-9580-05730dd73604" status: 200 len: 1318 microversion: 2.1 time: 0.554504 Feb 19 05:01:36.731993 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 136/247] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:01:36 2021] GET /compute/v2.1/servers/3aafde29-2f77-4921-9580-05730dd73604 => generated 1318 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:01:36.742611 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-fa7096c0-2263-46de-83f7-33a0e9c45245 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:01:36.744422 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-fa7096c0-2263-46de-83f7-33a0e9c45245 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] [instance: 798b77ff-c3ca-4c65-a120-db12ad953621] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:01:36.761820 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-fa7096c0-2263-46de-83f7-33a0e9c45245 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:36.762741 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-fa7096c0-2263-46de-83f7-33a0e9c45245 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:36.764362 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-fa7096c0-2263-46de-83f7-33a0e9c45245 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:36.765259 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-fa7096c0-2263-46de-83f7-33a0e9c45245 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:36.786203 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.virt.hardware [None req-bc0a10a8-940a-4d30-959b-613368d159a5 tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Flavor limits 0:0:0 {{(pid=98153) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 19 05:01:36.786683 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.virt.hardware [None req-bc0a10a8-940a-4d30-959b-613368d159a5 tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Image limits 0:0:0 {{(pid=98153) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Feb 19 05:01:36.787278 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.virt.hardware [None req-bc0a10a8-940a-4d30-959b-613368d159a5 tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Flavor pref 0:0:0 {{(pid=98153) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 19 05:01:36.787824 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.virt.hardware [None req-bc0a10a8-940a-4d30-959b-613368d159a5 tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Image pref 0:0:0 {{(pid=98153) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Feb 19 05:01:36.788288 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.virt.hardware [None req-bc0a10a8-940a-4d30-959b-613368d159a5 tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98153) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Feb 19 05:01:36.798357 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-bc0a10a8-940a-4d30-959b-613368d159a5 tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:36.798863 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-bc0a10a8-940a-4d30-959b-613368d159a5 tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:36.799816 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-bc0a10a8-940a-4d30-959b-613368d159a5 tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:36.800862 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-bc0a10a8-940a-4d30-959b-613368d159a5 tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:36.823559 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.quota [None req-bc0a10a8-940a-4d30-959b-613368d159a5 tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Getting quotas for project b461024d8cdf4d5c966d746682381d79. Resources: {'instances', 'ram', 'cores'} {{(pid=98153) _get_quotas /opt/stack/nova/nova/quota.py:388}} Feb 19 05:01:36.829377 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.quota [None req-bc0a10a8-940a-4d30-959b-613368d159a5 tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Getting quotas for user 876d82b7755b4c1f91c8ad200c0f567f and project b461024d8cdf4d5c966d746682381d79. Resources: {'instances', 'ram', 'cores'} {{(pid=98153) _get_quotas /opt/stack/nova/nova/quota.py:380}} Feb 19 05:01:36.843481 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-bc0a10a8-940a-4d30-959b-613368d159a5 tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Going to run 1 instances... {{(pid=98153) _provision_instances /opt/stack/nova/nova/compute/api.py:1264}} Feb 19 05:01:36.846355 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-bc0a10a8-940a-4d30-959b-613368d159a5 tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] [instance: 0d55dde2-c4d7-4da3-9f14-2e6a30f69bcb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='53cdf9de-e495-4ca8-845f-6be2bf32cecb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98153) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1666}} Feb 19 05:01:36.918983 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-bc0a10a8-940a-4d30-959b-613368d159a5 tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.270656 Feb 19 05:01:36.920210 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 112/248] 10.222.0.47 () {60 vars in 1137 bytes} [Fri Feb 19 05:01:35 2021] POST /compute/v2.1/servers => generated 380 bytes in 1273 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 19 05:01:36.949018 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-dda2e2f3-af2f-4793-b435-ffc86e1c42ab tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:01:36.950950 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-dda2e2f3-af2f-4793-b435-ffc86e1c42ab tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] [instance: be65ea57-bc8d-4bce-80c3-33d8b6007ed1] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:01:36.980813 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-dda2e2f3-af2f-4793-b435-ffc86e1c42ab tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:36.981046 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-dda2e2f3-af2f-4793-b435-ffc86e1c42ab tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:36.982735 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-dda2e2f3-af2f-4793-b435-ffc86e1c42ab tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:36.983902 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-dda2e2f3-af2f-4793-b435-ffc86e1c42ab tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:37.026028 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-fa7096c0-2263-46de-83f7-33a0e9c45245 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] 10.222.0.47 "POST /compute/v2.1/servers/798b77ff-c3ca-4c65-a120-db12ad953621/action" status: 200 len: 28761 microversion: 2.20 time: 0.291510 Feb 19 05:01:37.027683 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 137/249] 10.222.0.47 () {62 vars in 1309 bytes} [Fri Feb 19 05:01:36 2021] POST /compute/v2.1/servers/798b77ff-c3ca-4c65-a120-db12ad953621/action => generated 28761 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 19 05:01:37.057907 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-49cb7854-d1d8-4aab-abfb-b21632216eb5 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:01:37.060300 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-49cb7854-d1d8-4aab-abfb-b21632216eb5 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] [instance: 74c5a115-b174-49fe-9b75-574e484a09e2] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:01:37.089527 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-49cb7854-d1d8-4aab-abfb-b21632216eb5 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:37.090042 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-49cb7854-d1d8-4aab-abfb-b21632216eb5 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:37.090921 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-49cb7854-d1d8-4aab-abfb-b21632216eb5 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:37.091460 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-49cb7854-d1d8-4aab-abfb-b21632216eb5 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:37.180089 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.objects.instance [None req-49cb7854-d1d8-4aab-abfb-b21632216eb5 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lazy-loading 'flavor' on Instance uuid 74c5a115-b174-49fe-9b75-574e484a09e2 {{(pid=98154) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Feb 19 05:01:37.269478 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-dda2e2f3-af2f-4793-b435-ffc86e1c42ab tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] 10.222.0.47 "POST /compute/v2.1/servers/be65ea57-bc8d-4bce-80c3-33d8b6007ed1/action" status: 200 len: 28410 microversion: 2.1 time: 0.346426 Feb 19 05:01:37.271847 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 113/250] 10.222.0.47 () {60 vars in 1268 bytes} [Fri Feb 19 05:01:36 2021] POST /compute/v2.1/servers/be65ea57-bc8d-4bce-80c3-33d8b6007ed1/action => generated 28410 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 19 05:01:37.285732 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-8945434c-2734-4553-99e2-cfc91fb2eda9 tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:01:37.287966 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-8945434c-2734-4553-99e2-cfc91fb2eda9 tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] [instance: 0d55dde2-c4d7-4da3-9f14-2e6a30f69bcb] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:01:37.449607 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-49cb7854-d1d8-4aab-abfb-b21632216eb5 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] 10.222.0.47 "POST /compute/v2.1/servers/74c5a115-b174-49fe-9b75-574e484a09e2/action" status: 200 len: 32 microversion: 2.1 time: 0.415797 Feb 19 05:01:37.458418 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 138/251] 10.222.0.47 () {60 vars in 1268 bytes} [Fri Feb 19 05:01:37 2021] POST /compute/v2.1/servers/74c5a115-b174-49fe-9b75-574e484a09e2/action => generated 32 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 19 05:01:37.458752 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-8945434c-2734-4553-99e2-cfc91fb2eda9 tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '876d82b7755b4c1f91c8ad200c0f567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b461024d8cdf4d5c966d746682381d79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:01:37.470598 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-4e665eca-5507-4bc4-94f4-a84d6fe19534 tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:01:37.471778 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-4e665eca-5507-4bc4-94f4-a84d6fe19534 tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] [instance: 65b5a76b-3d64-4b51-b955-04f6bdc76253] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:01:37.483146 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-8945434c-2734-4553-99e2-cfc91fb2eda9 tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] 10.222.0.47 "GET /compute/v2.1/servers/0d55dde2-c4d7-4da3-9f14-2e6a30f69bcb" status: 200 len: 1218 microversion: 2.1 time: 0.207109 Feb 19 05:01:37.484057 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 114/252] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:01:37 2021] GET /compute/v2.1/servers/0d55dde2-c4d7-4da3-9f14-2e6a30f69bcb => generated 1218 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:01:37.493467 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-75cef04e-cd5e-4800-9c21-c4942eb761b0 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:01:37.494396 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-75cef04e-cd5e-4800-9c21-c4942eb761b0 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] [instance: 74c5a115-b174-49fe-9b75-574e484a09e2] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:01:37.501487 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-4e665eca-5507-4bc4-94f4-a84d6fe19534 tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:37.505138 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-4e665eca-5507-4bc4-94f4-a84d6fe19534 tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:37.508443 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-4e665eca-5507-4bc4-94f4-a84d6fe19534 tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:37.509205 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-4e665eca-5507-4bc4-94f4-a84d6fe19534 tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:37.514119 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-75cef04e-cd5e-4800-9c21-c4942eb761b0 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:37.517154 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-75cef04e-cd5e-4800-9c21-c4942eb761b0 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:37.518353 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-75cef04e-cd5e-4800-9c21-c4942eb761b0 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:37.520279 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-75cef04e-cd5e-4800-9c21-c4942eb761b0 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:38.157577 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-4e665eca-5507-4bc4-94f4-a84d6fe19534 tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ac58c346fa4d569782f22a3394e22a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f6827c056bf4dc0b68a527187f4be9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:01:38.178337 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-4e665eca-5507-4bc4-94f4-a84d6fe19534 tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] 10.222.0.47 "GET /compute/v2.1/servers/65b5a76b-3d64-4b51-b955-04f6bdc76253" status: 200 len: 1503 microversion: 2.1 time: 0.710765 Feb 19 05:01:38.179651 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 139/253] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:01:37 2021] GET /compute/v2.1/servers/65b5a76b-3d64-4b51-b955-04f6bdc76253 => generated 1503 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:01:38.180786 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-75cef04e-cd5e-4800-9c21-c4942eb761b0 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24af0562e2aa43ca9d601be5e16fe9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ee9a43087d5497da3af9fbf68c4572d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:01:38.185114 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-949282af-e80c-4e84-bb70-374537a1054b tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:01:38.186361 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-949282af-e80c-4e84-bb70-374537a1054b tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] [instance: 3aafde29-2f77-4921-9580-05730dd73604] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:01:38.195468 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-75cef04e-cd5e-4800-9c21-c4942eb761b0 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] 10.222.0.47 "GET /compute/v2.1/servers/74c5a115-b174-49fe-9b75-574e484a09e2" status: 200 len: 1519 microversion: 2.1 time: 0.710018 Feb 19 05:01:38.196125 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 115/254] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:01:37 2021] GET /compute/v2.1/servers/74c5a115-b174-49fe-9b75-574e484a09e2 => generated 1519 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:01:38.205062 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-949282af-e80c-4e84-bb70-374537a1054b tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:38.206381 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-949282af-e80c-4e84-bb70-374537a1054b tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:38.215736 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-949282af-e80c-4e84-bb70-374537a1054b tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:38.216743 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-949282af-e80c-4e84-bb70-374537a1054b tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:38.239228 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [req-50194025-2235-4be2-ae12-c230e495e756 req-8ba58660-83ee-46ba-b0a2-28cc35b53e3e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3aafde29-2f77-4921-9580-05730dd73604", "name": "network-vif-plugged", "status": "completed", "tag": "bcb6d6a6-4ff3-4e7d-abec-293ccd22f45b"}]} {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:01:38.242267 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 05:01:38.242267 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: warnings.warn(msg) Feb 19 05:01:38.255015 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [req-50194025-2235-4be2-ae12-c230e495e756 req-8ba58660-83ee-46ba-b0a2-28cc35b53e3e service nova] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:38.280200 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [req-50194025-2235-4be2-ae12-c230e495e756 req-8ba58660-83ee-46ba-b0a2-28cc35b53e3e service nova] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:38.369918 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.compute.server_external_events [req-50194025-2235-4be2-ae12-c230e495e756 req-8ba58660-83ee-46ba-b0a2-28cc35b53e3e service nova] Creating event network-vif-plugged:bcb6d6a6-4ff3-4e7d-abec-293ccd22f45b for instance 3aafde29-2f77-4921-9580-05730dd73604 on hv-cinder-77642 Feb 19 05:01:38.381356 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [req-50194025-2235-4be2-ae12-c230e495e756 req-8ba58660-83ee-46ba-b0a2-28cc35b53e3e service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.168157 Feb 19 05:01:38.382338 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 116/255] 10.222.0.47 () {64 vars in 1308 bytes} [Fri Feb 19 05:01:38 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 05:01:38.388560 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-6d6d2da6-d874-4406-8a5d-656c8d715ca6 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:01:38.389747 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-6d6d2da6-d874-4406-8a5d-656c8d715ca6 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] [instance: 798b77ff-c3ca-4c65-a120-db12ad953621] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:01:38.422451 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-6d6d2da6-d874-4406-8a5d-656c8d715ca6 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:38.422451 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-6d6d2da6-d874-4406-8a5d-656c8d715ca6 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:38.428950 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-6d6d2da6-d874-4406-8a5d-656c8d715ca6 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:38.429675 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-6d6d2da6-d874-4406-8a5d-656c8d715ca6 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:38.724851 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-6d6d2da6-d874-4406-8a5d-656c8d715ca6 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] 10.222.0.47 "POST /compute/v2.1/servers/798b77ff-c3ca-4c65-a120-db12ad953621/action" status: 200 len: 30979 microversion: 2.20 time: 0.338791 Feb 19 05:01:38.727235 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 117/256] 10.222.0.47 () {62 vars in 1309 bytes} [Fri Feb 19 05:01:38 2021] POST /compute/v2.1/servers/798b77ff-c3ca-4c65-a120-db12ad953621/action => generated 30979 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 19 05:01:38.763697 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-3d63b129-aa8e-41cf-a8cc-b99298ff54f3 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:01:38.766307 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-3d63b129-aa8e-41cf-a8cc-b99298ff54f3 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] [instance: be65ea57-bc8d-4bce-80c3-33d8b6007ed1] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:01:38.787502 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-3d63b129-aa8e-41cf-a8cc-b99298ff54f3 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:38.789114 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-3d63b129-aa8e-41cf-a8cc-b99298ff54f3 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:38.791319 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-3d63b129-aa8e-41cf-a8cc-b99298ff54f3 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:38.792595 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-3d63b129-aa8e-41cf-a8cc-b99298ff54f3 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:39.038216 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-949282af-e80c-4e84-bb70-374537a1054b tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628d846121a14be78329ccc727c8869d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa473e12960449bbb0713a709e0abe4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:01:39.049814 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-949282af-e80c-4e84-bb70-374537a1054b tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] 10.222.0.47 "GET /compute/v2.1/servers/3aafde29-2f77-4921-9580-05730dd73604" status: 200 len: 1318 microversion: 2.1 time: 0.868746 Feb 19 05:01:39.052358 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 140/257] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:01:38 2021] GET /compute/v2.1/servers/3aafde29-2f77-4921-9580-05730dd73604 => generated 1318 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:01:39.070402 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-1dfe3d36-e828-42be-8c0f-607365e21891 tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:01:39.071457 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-1dfe3d36-e828-42be-8c0f-607365e21891 tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] [instance: 0d55dde2-c4d7-4da3-9f14-2e6a30f69bcb] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:01:39.076293 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-3d63b129-aa8e-41cf-a8cc-b99298ff54f3 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] 10.222.0.47 "POST /compute/v2.1/servers/be65ea57-bc8d-4bce-80c3-33d8b6007ed1/action" status: 200 len: 28588 microversion: 2.1 time: 0.345430 Feb 19 05:01:39.077645 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 118/258] 10.222.0.47 () {60 vars in 1268 bytes} [Fri Feb 19 05:01:38 2021] POST /compute/v2.1/servers/be65ea57-bc8d-4bce-80c3-33d8b6007ed1/action => generated 28588 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 19 05:01:39.088476 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-1dfe3d36-e828-42be-8c0f-607365e21891 tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:39.089243 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-1dfe3d36-e828-42be-8c0f-607365e21891 tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:39.090885 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-1dfe3d36-e828-42be-8c0f-607365e21891 tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:39.091875 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-1dfe3d36-e828-42be-8c0f-607365e21891 tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:39.217280 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-d83ad178-d8c6-4929-bf66-de030394a84a tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:01:39.221422 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-d83ad178-d8c6-4929-bf66-de030394a84a tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] [instance: 65b5a76b-3d64-4b51-b955-04f6bdc76253] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:01:39.246077 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-d83ad178-d8c6-4929-bf66-de030394a84a tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:39.247132 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-d83ad178-d8c6-4929-bf66-de030394a84a tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:39.248792 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-d83ad178-d8c6-4929-bf66-de030394a84a tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:39.249803 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-d83ad178-d8c6-4929-bf66-de030394a84a tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:39.309999 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-1dfe3d36-e828-42be-8c0f-607365e21891 tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '876d82b7755b4c1f91c8ad200c0f567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b461024d8cdf4d5c966d746682381d79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:01:39.331561 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-1dfe3d36-e828-42be-8c0f-607365e21891 tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] 10.222.0.47 "GET /compute/v2.1/servers/0d55dde2-c4d7-4da3-9f14-2e6a30f69bcb" status: 200 len: 1270 microversion: 2.1 time: 0.278556 Feb 19 05:01:39.333165 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 141/259] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:01:39 2021] GET /compute/v2.1/servers/0d55dde2-c4d7-4da3-9f14-2e6a30f69bcb => generated 1270 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:01:39.361298 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-b019c044-3519-4f50-9bc6-1bafc76f3670 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:01:39.363520 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-b019c044-3519-4f50-9bc6-1bafc76f3670 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] [instance: 74c5a115-b174-49fe-9b75-574e484a09e2] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:01:39.381527 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-b019c044-3519-4f50-9bc6-1bafc76f3670 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:39.382406 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-b019c044-3519-4f50-9bc6-1bafc76f3670 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:39.383709 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-b019c044-3519-4f50-9bc6-1bafc76f3670 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:39.384367 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-b019c044-3519-4f50-9bc6-1bafc76f3670 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:40.151667 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-d83ad178-d8c6-4929-bf66-de030394a84a tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ac58c346fa4d569782f22a3394e22a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f6827c056bf4dc0b68a527187f4be9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:01:40.168172 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-d83ad178-d8c6-4929-bf66-de030394a84a tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] 10.222.0.47 "GET /compute/v2.1/servers/65b5a76b-3d64-4b51-b955-04f6bdc76253" status: 200 len: 1503 microversion: 2.1 time: 0.960738 Feb 19 05:01:40.168629 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-b019c044-3519-4f50-9bc6-1bafc76f3670 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24af0562e2aa43ca9d601be5e16fe9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ee9a43087d5497da3af9fbf68c4572d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:01:40.176056 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 119/260] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:01:39 2021] GET /compute/v2.1/servers/65b5a76b-3d64-4b51-b955-04f6bdc76253 => generated 1503 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 05:01:40.181583 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-f9b0ea6c-5f6d-4133-971d-9ec5e67a676c tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:01:40.182734 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-f9b0ea6c-5f6d-4133-971d-9ec5e67a676c tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] [instance: 798b77ff-c3ca-4c65-a120-db12ad953621] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:01:40.192342 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-f9b0ea6c-5f6d-4133-971d-9ec5e67a676c tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:40.192774 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-f9b0ea6c-5f6d-4133-971d-9ec5e67a676c tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:40.193645 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-f9b0ea6c-5f6d-4133-971d-9ec5e67a676c tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:40.194138 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-f9b0ea6c-5f6d-4133-971d-9ec5e67a676c tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:40.200560 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-b019c044-3519-4f50-9bc6-1bafc76f3670 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] 10.222.0.47 "GET /compute/v2.1/servers/74c5a115-b174-49fe-9b75-574e484a09e2" status: 200 len: 1519 microversion: 2.1 time: 0.854117 Feb 19 05:01:40.201718 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 142/261] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:01:39 2021] GET /compute/v2.1/servers/74c5a115-b174-49fe-9b75-574e484a09e2 => generated 1519 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:01:40.213479 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-8e35c4f9-4d08-4521-a31f-037b879b4bb4 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:01:40.215249 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-8e35c4f9-4d08-4521-a31f-037b879b4bb4 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] [instance: 3aafde29-2f77-4921-9580-05730dd73604] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:01:40.232598 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-8e35c4f9-4d08-4521-a31f-037b879b4bb4 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:40.239020 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-8e35c4f9-4d08-4521-a31f-037b879b4bb4 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:40.240849 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-8e35c4f9-4d08-4521-a31f-037b879b4bb4 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:40.241786 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-8e35c4f9-4d08-4521-a31f-037b879b4bb4 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:40.390886 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-f9b0ea6c-5f6d-4133-971d-9ec5e67a676c tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] 10.222.0.47 "POST /compute/v2.1/servers/798b77ff-c3ca-4c65-a120-db12ad953621/action" status: 200 len: 32751 microversion: 2.20 time: 0.212971 Feb 19 05:01:40.392192 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 120/262] 10.222.0.47 () {62 vars in 1309 bytes} [Fri Feb 19 05:01:40 2021] POST /compute/v2.1/servers/798b77ff-c3ca-4c65-a120-db12ad953621/action => generated 32751 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 19 05:01:40.402915 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-22bd1369-ba2f-4f04-8883-39434df27bb6 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:01:40.404359 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-22bd1369-ba2f-4f04-8883-39434df27bb6 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] [instance: be65ea57-bc8d-4bce-80c3-33d8b6007ed1] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:01:40.417155 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-22bd1369-ba2f-4f04-8883-39434df27bb6 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:40.418549 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-22bd1369-ba2f-4f04-8883-39434df27bb6 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:40.419689 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-22bd1369-ba2f-4f04-8883-39434df27bb6 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:40.420342 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-22bd1369-ba2f-4f04-8883-39434df27bb6 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:40.649262 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-22bd1369-ba2f-4f04-8883-39434df27bb6 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] 10.222.0.47 "POST /compute/v2.1/servers/be65ea57-bc8d-4bce-80c3-33d8b6007ed1/action" status: 200 len: 28616 microversion: 2.1 time: 0.253918 Feb 19 05:01:40.654242 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 121/263] 10.222.0.47 () {60 vars in 1268 bytes} [Fri Feb 19 05:01:40 2021] POST /compute/v2.1/servers/be65ea57-bc8d-4bce-80c3-33d8b6007ed1/action => generated 28616 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 19 05:01:40.661070 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-86107e28-21e3-45e3-874d-4f32dc63d713 tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:01:40.661886 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-86107e28-21e3-45e3-874d-4f32dc63d713 tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] [instance: 0d55dde2-c4d7-4da3-9f14-2e6a30f69bcb] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:01:40.671960 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-86107e28-21e3-45e3-874d-4f32dc63d713 tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:40.672535 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-86107e28-21e3-45e3-874d-4f32dc63d713 tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:40.673507 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-86107e28-21e3-45e3-874d-4f32dc63d713 tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:40.674020 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-86107e28-21e3-45e3-874d-4f32dc63d713 tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:41.005458 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-86107e28-21e3-45e3-874d-4f32dc63d713 tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '876d82b7755b4c1f91c8ad200c0f567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b461024d8cdf4d5c966d746682381d79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:01:41.016918 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-86107e28-21e3-45e3-874d-4f32dc63d713 tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] 10.222.0.47 "GET /compute/v2.1/servers/0d55dde2-c4d7-4da3-9f14-2e6a30f69bcb" status: 200 len: 1276 microversion: 2.1 time: 0.361120 Feb 19 05:01:41.017830 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 122/264] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:01:40 2021] GET /compute/v2.1/servers/0d55dde2-c4d7-4da3-9f14-2e6a30f69bcb => generated 1276 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:01:41.024739 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [req-9eed42e0-1a0e-42f7-9ab3-011f0df13800 req-e08d8f10-b96a-488b-9d60-cfaa398eafa7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65b5a76b-3d64-4b51-b955-04f6bdc76253", "name": "network-vif-unplugged", "status": "completed", "tag": "e233c19f-946c-4ce2-98af-3c1203421dda"}]} {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:01:41.051815 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 05:01:41.051815 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: warnings.warn(msg) Feb 19 05:01:41.065988 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [req-9eed42e0-1a0e-42f7-9ab3-011f0df13800 req-e08d8f10-b96a-488b-9d60-cfaa398eafa7 service nova] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:41.067097 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [req-9eed42e0-1a0e-42f7-9ab3-011f0df13800 req-e08d8f10-b96a-488b-9d60-cfaa398eafa7 service nova] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:41.088771 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.compute.server_external_events [req-9eed42e0-1a0e-42f7-9ab3-011f0df13800 req-e08d8f10-b96a-488b-9d60-cfaa398eafa7 service nova] Creating event network-vif-unplugged:e233c19f-946c-4ce2-98af-3c1203421dda for instance 65b5a76b-3d64-4b51-b955-04f6bdc76253 on hv-cinder-77642 Feb 19 05:01:41.095021 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [req-9eed42e0-1a0e-42f7-9ab3-011f0df13800 req-e08d8f10-b96a-488b-9d60-cfaa398eafa7 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.075623 Feb 19 05:01:41.095966 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 123/265] 10.222.0.47 () {64 vars in 1308 bytes} [Fri Feb 19 05:01:41 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 05:01:41.102640 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [req-4dba8e4b-952a-45c5-bd5d-b443e6e8841e req-a56301ae-ca10-4d31-989d-bb7f7a376ca3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65b5a76b-3d64-4b51-b955-04f6bdc76253", "name": "network-vif-deleted", "tag": "e233c19f-946c-4ce2-98af-3c1203421dda"}]} {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:01:41.104798 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 05:01:41.104798 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: warnings.warn(msg) Feb 19 05:01:41.116610 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [req-4dba8e4b-952a-45c5-bd5d-b443e6e8841e req-a56301ae-ca10-4d31-989d-bb7f7a376ca3 service nova] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:41.117106 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [req-4dba8e4b-952a-45c5-bd5d-b443e6e8841e req-a56301ae-ca10-4d31-989d-bb7f7a376ca3 service nova] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:41.137390 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.compute.server_external_events [req-4dba8e4b-952a-45c5-bd5d-b443e6e8841e req-a56301ae-ca10-4d31-989d-bb7f7a376ca3 service nova] Creating event network-vif-deleted:e233c19f-946c-4ce2-98af-3c1203421dda for instance 65b5a76b-3d64-4b51-b955-04f6bdc76253 on hv-cinder-77642 Feb 19 05:01:41.146275 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [req-4dba8e4b-952a-45c5-bd5d-b443e6e8841e req-a56301ae-ca10-4d31-989d-bb7f7a376ca3 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047224 Feb 19 05:01:41.147734 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 124/266] 10.222.0.47 () {64 vars in 1308 bytes} [Fri Feb 19 05:01:41 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 05:01:41.203021 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-9a9018b6-2fe7-4256-aa49-4bc98a27d5a9 tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:01:41.204834 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-9a9018b6-2fe7-4256-aa49-4bc98a27d5a9 tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] [instance: 65b5a76b-3d64-4b51-b955-04f6bdc76253] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:01:41.225723 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-9a9018b6-2fe7-4256-aa49-4bc98a27d5a9 tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:41.225723 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-9a9018b6-2fe7-4256-aa49-4bc98a27d5a9 tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:41.226157 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-8e35c4f9-4d08-4521-a31f-037b879b4bb4 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628d846121a14be78329ccc727c8869d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa473e12960449bbb0713a709e0abe4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:01:41.226321 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-9a9018b6-2fe7-4256-aa49-4bc98a27d5a9 tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:41.226953 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-9a9018b6-2fe7-4256-aa49-4bc98a27d5a9 tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:41.241542 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-8e35c4f9-4d08-4521-a31f-037b879b4bb4 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] 10.222.0.47 "GET /compute/v2.1/servers/3aafde29-2f77-4921-9580-05730dd73604" status: 200 len: 1318 microversion: 2.1 time: 1.037280 Feb 19 05:01:41.242214 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 143/267] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:01:40 2021] GET /compute/v2.1/servers/3aafde29-2f77-4921-9580-05730dd73604 => generated 1318 bytes in 1039 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:01:41.246903 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-17d3beea-13fb-4e69-8f35-84c553a71127 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:01:41.250199 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-17d3beea-13fb-4e69-8f35-84c553a71127 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] [instance: 74c5a115-b174-49fe-9b75-574e484a09e2] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:01:41.260934 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-17d3beea-13fb-4e69-8f35-84c553a71127 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:41.261903 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-17d3beea-13fb-4e69-8f35-84c553a71127 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:41.263439 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-17d3beea-13fb-4e69-8f35-84c553a71127 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:41.264136 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-17d3beea-13fb-4e69-8f35-84c553a71127 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:41.390408 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-9a9018b6-2fe7-4256-aa49-4bc98a27d5a9 tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ac58c346fa4d569782f22a3394e22a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f6827c056bf4dc0b68a527187f4be9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:01:41.407719 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-9a9018b6-2fe7-4256-aa49-4bc98a27d5a9 tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] 10.222.0.47 "GET /compute/v2.1/servers/65b5a76b-3d64-4b51-b955-04f6bdc76253" status: 200 len: 1299 microversion: 2.1 time: 0.213501 Feb 19 05:01:41.428428 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 125/268] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:01:41 2021] GET /compute/v2.1/servers/65b5a76b-3d64-4b51-b955-04f6bdc76253 => generated 1299 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:01:41.434521 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-15ece422-9aa9-482b-afb6-86fbc60b0857 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:01:41.435916 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-15ece422-9aa9-482b-afb6-86fbc60b0857 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] [instance: 798b77ff-c3ca-4c65-a120-db12ad953621] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:01:41.454220 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-15ece422-9aa9-482b-afb6-86fbc60b0857 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:41.455114 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-15ece422-9aa9-482b-afb6-86fbc60b0857 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:41.458218 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-15ece422-9aa9-482b-afb6-86fbc60b0857 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:41.459148 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-15ece422-9aa9-482b-afb6-86fbc60b0857 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:41.740909 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-15ece422-9aa9-482b-afb6-86fbc60b0857 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] 10.222.0.47 "POST /compute/v2.1/servers/798b77ff-c3ca-4c65-a120-db12ad953621/action" status: 200 len: 33417 microversion: 2.20 time: 0.310528 Feb 19 05:01:41.748421 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 126/269] 10.222.0.47 () {62 vars in 1309 bytes} [Fri Feb 19 05:01:41 2021] POST /compute/v2.1/servers/798b77ff-c3ca-4c65-a120-db12ad953621/action => generated 33417 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 19 05:01:41.751788 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-232375f5-2dc8-4928-87c1-0cedf3805097 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:01:41.754114 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-232375f5-2dc8-4928-87c1-0cedf3805097 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] [instance: be65ea57-bc8d-4bce-80c3-33d8b6007ed1] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:01:41.766273 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-232375f5-2dc8-4928-87c1-0cedf3805097 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:41.767417 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-232375f5-2dc8-4928-87c1-0cedf3805097 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:41.768609 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-232375f5-2dc8-4928-87c1-0cedf3805097 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:41.769890 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-232375f5-2dc8-4928-87c1-0cedf3805097 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:42.012374 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-17d3beea-13fb-4e69-8f35-84c553a71127 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24af0562e2aa43ca9d601be5e16fe9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ee9a43087d5497da3af9fbf68c4572d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:01:42.026869 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-17d3beea-13fb-4e69-8f35-84c553a71127 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] 10.222.0.47 "GET /compute/v2.1/servers/74c5a115-b174-49fe-9b75-574e484a09e2" status: 200 len: 1519 microversion: 2.1 time: 0.783667 Feb 19 05:01:42.028369 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 144/270] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:01:41 2021] GET /compute/v2.1/servers/74c5a115-b174-49fe-9b75-574e484a09e2 => generated 1519 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:01:42.056840 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-f30ee740-847e-42c3-b860-8ca3c9c5ae6a tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:01:42.057869 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-f30ee740-847e-42c3-b860-8ca3c9c5ae6a tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] [instance: 0d55dde2-c4d7-4da3-9f14-2e6a30f69bcb] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:01:42.067855 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-f30ee740-847e-42c3-b860-8ca3c9c5ae6a tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:42.068755 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-f30ee740-847e-42c3-b860-8ca3c9c5ae6a tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:42.069861 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-f30ee740-847e-42c3-b860-8ca3c9c5ae6a tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:42.070567 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-f30ee740-847e-42c3-b860-8ca3c9c5ae6a tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:42.220498 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-232375f5-2dc8-4928-87c1-0cedf3805097 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] 10.222.0.47 "POST /compute/v2.1/servers/be65ea57-bc8d-4bce-80c3-33d8b6007ed1/action" status: 200 len: 28616 microversion: 2.1 time: 0.475595 Feb 19 05:01:42.221484 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 127/271] 10.222.0.47 () {60 vars in 1268 bytes} [Fri Feb 19 05:01:41 2021] POST /compute/v2.1/servers/be65ea57-bc8d-4bce-80c3-33d8b6007ed1/action => generated 28616 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 19 05:01:42.290161 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-0b8e243b-1aa3-4a94-8937-a2cc65ed9b1c tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:01:42.291152 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-0b8e243b-1aa3-4a94-8937-a2cc65ed9b1c tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] [instance: 3aafde29-2f77-4921-9580-05730dd73604] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:01:42.301711 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-0b8e243b-1aa3-4a94-8937-a2cc65ed9b1c tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:42.302352 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-0b8e243b-1aa3-4a94-8937-a2cc65ed9b1c tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:42.303372 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-0b8e243b-1aa3-4a94-8937-a2cc65ed9b1c tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:42.303949 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-0b8e243b-1aa3-4a94-8937-a2cc65ed9b1c tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:42.400963 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-f30ee740-847e-42c3-b860-8ca3c9c5ae6a tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '876d82b7755b4c1f91c8ad200c0f567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b461024d8cdf4d5c966d746682381d79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:01:42.411894 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-f30ee740-847e-42c3-b860-8ca3c9c5ae6a tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] 10.222.0.47 "GET /compute/v2.1/servers/0d55dde2-c4d7-4da3-9f14-2e6a30f69bcb" status: 200 len: 1276 microversion: 2.1 time: 0.359892 Feb 19 05:01:42.412971 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 145/272] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:01:42 2021] GET /compute/v2.1/servers/0d55dde2-c4d7-4da3-9f14-2e6a30f69bcb => generated 1276 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:01:42.430402 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-72f533e2-99be-4166-9de8-6137ebd10adc tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:01:42.431108 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-72f533e2-99be-4166-9de8-6137ebd10adc tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] [instance: 65b5a76b-3d64-4b51-b955-04f6bdc76253] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:01:42.440134 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-72f533e2-99be-4166-9de8-6137ebd10adc tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:42.440555 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-72f533e2-99be-4166-9de8-6137ebd10adc tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:42.442318 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-72f533e2-99be-4166-9de8-6137ebd10adc tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:42.442853 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-72f533e2-99be-4166-9de8-6137ebd10adc tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:42.506732 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.wsgi [None req-72f533e2-99be-4166-9de8-6137ebd10adc tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] HTTP exception thrown: Instance 65b5a76b-3d64-4b51-b955-04f6bdc76253 could not be found. Feb 19 05:01:42.507460 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-72f533e2-99be-4166-9de8-6137ebd10adc tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Returning 404 to user: Instance 65b5a76b-3d64-4b51-b955-04f6bdc76253 could not be found. {{(pid=98154) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 19 05:01:42.508391 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-72f533e2-99be-4166-9de8-6137ebd10adc tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] 10.222.0.47 "GET /compute/v2.1/servers/65b5a76b-3d64-4b51-b955-04f6bdc76253" status: 404 len: 111 microversion: 2.1 time: 0.083360 Feb 19 05:01:42.509040 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 146/273] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:01:42 2021] GET /compute/v2.1/servers/65b5a76b-3d64-4b51-b955-04f6bdc76253 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 05:01:42.669889 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-0b8e243b-1aa3-4a94-8937-a2cc65ed9b1c tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628d846121a14be78329ccc727c8869d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa473e12960449bbb0713a709e0abe4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:01:42.694695 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-0b8e243b-1aa3-4a94-8937-a2cc65ed9b1c tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] 10.222.0.47 "GET /compute/v2.1/servers/3aafde29-2f77-4921-9580-05730dd73604" status: 200 len: 1509 microversion: 2.1 time: 0.419508 Feb 19 05:01:42.697531 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 128/274] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:01:42 2021] GET /compute/v2.1/servers/3aafde29-2f77-4921-9580-05730dd73604 => generated 1509 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:01:42.728732 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-d537c1fb-141e-4594-a99e-4eaa939c1541 tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-574518515", "imageRef": "53cdf9de-e495-4ca8-845f-6be2bf32cecb", "flavorRef": "452", "networks": [{"uuid": "c5268f31-5887-4751-b292-351f008461dc"}]}} {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:01:42.762611 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-f99a6c49-182d-4e56-ac48-1adcca6ef006 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:01:42.764735 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-f99a6c49-182d-4e56-ac48-1adcca6ef006 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] [instance: 798b77ff-c3ca-4c65-a120-db12ad953621] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:01:42.809765 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-f99a6c49-182d-4e56-ac48-1adcca6ef006 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:42.810695 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-f99a6c49-182d-4e56-ac48-1adcca6ef006 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:42.812388 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-f99a6c49-182d-4e56-ac48-1adcca6ef006 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:42.813308 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-f99a6c49-182d-4e56-ac48-1adcca6ef006 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:42.986445 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.network.neutron [None req-d537c1fb-141e-4594-a99e-4eaa939c1541 tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] validate_networks() for [('c5268f31-5887-4751-b292-351f008461dc', None, None, None)] {{(pid=98154) validate_networks /opt/stack/nova/nova/network/neutron.py:2345}} Feb 19 05:01:43.119367 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-f99a6c49-182d-4e56-ac48-1adcca6ef006 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] 10.222.0.47 "POST /compute/v2.1/servers/798b77ff-c3ca-4c65-a120-db12ad953621/action" status: 200 len: 33906 microversion: 2.20 time: 0.364880 Feb 19 05:01:43.121769 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 129/275] 10.222.0.47 () {62 vars in 1309 bytes} [Fri Feb 19 05:01:42 2021] POST /compute/v2.1/servers/798b77ff-c3ca-4c65-a120-db12ad953621/action => generated 33906 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 19 05:01:43.132235 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-01b9c85d-5bec-47ad-8fa0-ee1ebb957661 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:01:43.134257 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-01b9c85d-5bec-47ad-8fa0-ee1ebb957661 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] [instance: 74c5a115-b174-49fe-9b75-574e484a09e2] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:01:43.151285 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-01b9c85d-5bec-47ad-8fa0-ee1ebb957661 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:43.152228 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-01b9c85d-5bec-47ad-8fa0-ee1ebb957661 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:43.154189 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-01b9c85d-5bec-47ad-8fa0-ee1ebb957661 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:43.155055 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-01b9c85d-5bec-47ad-8fa0-ee1ebb957661 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:44.058479 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-01b9c85d-5bec-47ad-8fa0-ee1ebb957661 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24af0562e2aa43ca9d601be5e16fe9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ee9a43087d5497da3af9fbf68c4572d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:01:44.079011 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-01b9c85d-5bec-47ad-8fa0-ee1ebb957661 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] 10.222.0.47 "GET /compute/v2.1/servers/74c5a115-b174-49fe-9b75-574e484a09e2" status: 200 len: 1519 microversion: 2.1 time: 0.956056 Feb 19 05:01:44.080202 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 130/276] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:01:43 2021] GET /compute/v2.1/servers/74c5a115-b174-49fe-9b75-574e484a09e2 => generated 1519 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:01:44.091695 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-8fa0855f-5044-44d0-9514-4eba8f51bb4e tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:01:44.094270 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-8fa0855f-5044-44d0-9514-4eba8f51bb4e tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] [instance: be65ea57-bc8d-4bce-80c3-33d8b6007ed1] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:01:44.105633 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-8fa0855f-5044-44d0-9514-4eba8f51bb4e tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:44.106330 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-8fa0855f-5044-44d0-9514-4eba8f51bb4e tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:44.107374 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-8fa0855f-5044-44d0-9514-4eba8f51bb4e tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:44.107998 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-8fa0855f-5044-44d0-9514-4eba8f51bb4e tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:44.265462 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-8fa0855f-5044-44d0-9514-4eba8f51bb4e tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] 10.222.0.47 "POST /compute/v2.1/servers/be65ea57-bc8d-4bce-80c3-33d8b6007ed1/action" status: 200 len: 28616 microversion: 2.1 time: 0.183014 Feb 19 05:01:44.266362 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 131/277] 10.222.0.47 () {60 vars in 1268 bytes} [Fri Feb 19 05:01:44 2021] POST /compute/v2.1/servers/be65ea57-bc8d-4bce-80c3-33d8b6007ed1/action => generated 28616 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 19 05:01:44.275230 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-71626552-8094-46d8-9f7e-d868f3ff0ec9 tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:01:44.276287 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-71626552-8094-46d8-9f7e-d868f3ff0ec9 tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] [instance: 0d55dde2-c4d7-4da3-9f14-2e6a30f69bcb] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:01:44.287739 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-71626552-8094-46d8-9f7e-d868f3ff0ec9 tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:44.288483 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-71626552-8094-46d8-9f7e-d868f3ff0ec9 tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:44.289468 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-71626552-8094-46d8-9f7e-d868f3ff0ec9 tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:44.290067 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-71626552-8094-46d8-9f7e-d868f3ff0ec9 tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:44.593512 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.virt.hardware [None req-d537c1fb-141e-4594-a99e-4eaa939c1541 tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Flavor limits 0:0:0 {{(pid=98154) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 19 05:01:44.594400 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.virt.hardware [None req-d537c1fb-141e-4594-a99e-4eaa939c1541 tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Image limits 0:0:0 {{(pid=98154) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Feb 19 05:01:44.596033 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.virt.hardware [None req-d537c1fb-141e-4594-a99e-4eaa939c1541 tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Flavor pref 0:0:0 {{(pid=98154) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 19 05:01:44.597035 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.virt.hardware [None req-d537c1fb-141e-4594-a99e-4eaa939c1541 tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Image pref 0:0:0 {{(pid=98154) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Feb 19 05:01:44.598263 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.virt.hardware [None req-d537c1fb-141e-4594-a99e-4eaa939c1541 tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98154) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Feb 19 05:01:44.614902 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-d537c1fb-141e-4594-a99e-4eaa939c1541 tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:44.615928 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-d537c1fb-141e-4594-a99e-4eaa939c1541 tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:44.617769 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-d537c1fb-141e-4594-a99e-4eaa939c1541 tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:44.618695 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-d537c1fb-141e-4594-a99e-4eaa939c1541 tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:44.657122 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.quota [None req-d537c1fb-141e-4594-a99e-4eaa939c1541 tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Getting quotas for project 1f6827c056bf4dc0b68a527187f4be9e. Resources: {'instances', 'ram', 'cores'} {{(pid=98154) _get_quotas /opt/stack/nova/nova/quota.py:388}} Feb 19 05:01:44.664359 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.quota [None req-d537c1fb-141e-4594-a99e-4eaa939c1541 tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Getting quotas for user 50ac58c346fa4d569782f22a3394e22a and project 1f6827c056bf4dc0b68a527187f4be9e. Resources: {'instances', 'ram', 'cores'} {{(pid=98154) _get_quotas /opt/stack/nova/nova/quota.py:380}} Feb 19 05:01:44.680824 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-d537c1fb-141e-4594-a99e-4eaa939c1541 tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Going to run 1 instances... {{(pid=98154) _provision_instances /opt/stack/nova/nova/compute/api.py:1264}} Feb 19 05:01:44.684744 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-d537c1fb-141e-4594-a99e-4eaa939c1541 tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] [instance: 68e65823-58dc-4f2f-b814-bdd12dee87ad] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='53cdf9de-e495-4ca8-845f-6be2bf32cecb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98154) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1666}} Feb 19 05:01:44.826815 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-d537c1fb-141e-4594-a99e-4eaa939c1541 tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.106585 Feb 19 05:01:44.833893 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 147/278] 10.222.0.47 () {60 vars in 1137 bytes} [Fri Feb 19 05:01:42 2021] POST /compute/v2.1/servers => generated 380 bytes in 2109 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 19 05:01:44.844198 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-76ba525c-1e68-4ed4-a353-9d167dea9713 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:01:44.845356 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-76ba525c-1e68-4ed4-a353-9d167dea9713 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] [instance: 798b77ff-c3ca-4c65-a120-db12ad953621] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:01:44.856211 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-76ba525c-1e68-4ed4-a353-9d167dea9713 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:44.856987 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-76ba525c-1e68-4ed4-a353-9d167dea9713 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:44.858386 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-76ba525c-1e68-4ed4-a353-9d167dea9713 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:44.859086 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-76ba525c-1e68-4ed4-a353-9d167dea9713 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:45.022051 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-76ba525c-1e68-4ed4-a353-9d167dea9713 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] 10.222.0.47 "POST /compute/v2.1/servers/798b77ff-c3ca-4c65-a120-db12ad953621/action" status: 200 len: 35127 microversion: 2.20 time: 0.192307 Feb 19 05:01:45.023185 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 148/279] 10.222.0.47 () {62 vars in 1309 bytes} [Fri Feb 19 05:01:44 2021] POST /compute/v2.1/servers/798b77ff-c3ca-4c65-a120-db12ad953621/action => generated 35127 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 19 05:01:45.030057 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-4a5ebfe8-4a83-4212-a183-19b4ce4c6040 tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:01:45.031136 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-4a5ebfe8-4a83-4212-a183-19b4ce4c6040 tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] [instance: 68e65823-58dc-4f2f-b814-bdd12dee87ad] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:01:45.488169 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-71626552-8094-46d8-9f7e-d868f3ff0ec9 tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '876d82b7755b4c1f91c8ad200c0f567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b461024d8cdf4d5c966d746682381d79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:01:45.496874 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-4a5ebfe8-4a83-4212-a183-19b4ce4c6040 tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ac58c346fa4d569782f22a3394e22a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f6827c056bf4dc0b68a527187f4be9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:01:45.514940 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-4a5ebfe8-4a83-4212-a183-19b4ce4c6040 tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] 10.222.0.47 "GET /compute/v2.1/servers/68e65823-58dc-4f2f-b814-bdd12dee87ad" status: 200 len: 1213 microversion: 2.1 time: 0.490375 Feb 19 05:01:45.518417 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-71626552-8094-46d8-9f7e-d868f3ff0ec9 tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] 10.222.0.47 "GET /compute/v2.1/servers/0d55dde2-c4d7-4da3-9f14-2e6a30f69bcb" status: 200 len: 1318 microversion: 2.1 time: 1.250415 Feb 19 05:01:45.519864 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 149/280] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:01:45 2021] GET /compute/v2.1/servers/68e65823-58dc-4f2f-b814-bdd12dee87ad => generated 1213 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:01:45.536967 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 132/281] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:01:44 2021] GET /compute/v2.1/servers/0d55dde2-c4d7-4da3-9f14-2e6a30f69bcb => generated 1318 bytes in 1270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:01:45.547101 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-d7c377b7-8fb5-4e64-97ff-8390c25c192a tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4e40b0aa-5766-4740-aafe-bd71b380d261"}} {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:01:45.551785 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-0a21889b-a1d0-461f-abdc-27a22a2b6ff5 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:01:45.554121 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-d7c377b7-8fb5-4e64-97ff-8390c25c192a tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] [instance: 3aafde29-2f77-4921-9580-05730dd73604] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:01:45.555139 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-0a21889b-a1d0-461f-abdc-27a22a2b6ff5 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] [instance: 74c5a115-b174-49fe-9b75-574e484a09e2] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:01:45.574540 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-0a21889b-a1d0-461f-abdc-27a22a2b6ff5 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:45.575549 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-d7c377b7-8fb5-4e64-97ff-8390c25c192a tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:45.576168 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-d7c377b7-8fb5-4e64-97ff-8390c25c192a tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:45.576753 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-0a21889b-a1d0-461f-abdc-27a22a2b6ff5 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:45.577934 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-d7c377b7-8fb5-4e64-97ff-8390c25c192a tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:45.580059 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-d7c377b7-8fb5-4e64-97ff-8390c25c192a tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:45.580388 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-0a21889b-a1d0-461f-abdc-27a22a2b6ff5 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:45.580989 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-0a21889b-a1d0-461f-abdc-27a22a2b6ff5 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:46.272928 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-0a21889b-a1d0-461f-abdc-27a22a2b6ff5 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24af0562e2aa43ca9d601be5e16fe9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ee9a43087d5497da3af9fbf68c4572d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:01:46.283162 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-0a21889b-a1d0-461f-abdc-27a22a2b6ff5 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] 10.222.0.47 "GET /compute/v2.1/servers/74c5a115-b174-49fe-9b75-574e484a09e2" status: 200 len: 1519 microversion: 2.1 time: 0.744305 Feb 19 05:01:46.284137 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 133/282] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:01:45 2021] GET /compute/v2.1/servers/74c5a115-b174-49fe-9b75-574e484a09e2 => generated 1519 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:01:46.290623 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-b88904f7-be8b-429c-bc6b-55c86c79fa4c tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:01:46.291785 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-b88904f7-be8b-429c-bc6b-55c86c79fa4c tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] [instance: be65ea57-bc8d-4bce-80c3-33d8b6007ed1] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:01:46.304743 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-b88904f7-be8b-429c-bc6b-55c86c79fa4c tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:46.305260 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-b88904f7-be8b-429c-bc6b-55c86c79fa4c tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:46.306161 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-b88904f7-be8b-429c-bc6b-55c86c79fa4c tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:46.306639 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-b88904f7-be8b-429c-bc6b-55c86c79fa4c tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:46.499146 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-b88904f7-be8b-429c-bc6b-55c86c79fa4c tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] 10.222.0.47 "POST /compute/v2.1/servers/be65ea57-bc8d-4bce-80c3-33d8b6007ed1/action" status: 200 len: 29656 microversion: 2.1 time: 0.212071 Feb 19 05:01:46.501387 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 134/283] 10.222.0.47 () {60 vars in 1268 bytes} [Fri Feb 19 05:01:46 2021] POST /compute/v2.1/servers/be65ea57-bc8d-4bce-80c3-33d8b6007ed1/action => generated 29656 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 19 05:01:46.516992 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-71c0e4f7-4e38-4223-af4b-be07b2fd20a6 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:01:46.520818 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-71c0e4f7-4e38-4223-af4b-be07b2fd20a6 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] [instance: 798b77ff-c3ca-4c65-a120-db12ad953621] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:01:46.542715 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-71c0e4f7-4e38-4223-af4b-be07b2fd20a6 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:46.544035 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-71c0e4f7-4e38-4223-af4b-be07b2fd20a6 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:46.545849 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-71c0e4f7-4e38-4223-af4b-be07b2fd20a6 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:46.546963 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-71c0e4f7-4e38-4223-af4b-be07b2fd20a6 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:46.657587 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-d7c377b7-8fb5-4e64-97ff-8390c25c192a tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] 10.222.0.47 "POST /compute/v2.1/servers/3aafde29-2f77-4921-9580-05730dd73604/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.123020 Feb 19 05:01:46.661121 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 150/284] 10.222.0.47 () {60 vars in 1313 bytes} [Fri Feb 19 05:01:45 2021] POST /compute/v2.1/servers/3aafde29-2f77-4921-9580-05730dd73604/os-volume_attachments => generated 194 bytes in 1127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 05:01:46.666566 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-0afd0ed1-0e0d-4e2b-a749-cc8fffe6b72d tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:01:46.667687 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-0afd0ed1-0e0d-4e2b-a749-cc8fffe6b72d tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] [instance: 68e65823-58dc-4f2f-b814-bdd12dee87ad] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:01:46.680997 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-0afd0ed1-0e0d-4e2b-a749-cc8fffe6b72d tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:46.681489 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-0afd0ed1-0e0d-4e2b-a749-cc8fffe6b72d tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:46.682573 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-0afd0ed1-0e0d-4e2b-a749-cc8fffe6b72d tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:46.683136 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-0afd0ed1-0e0d-4e2b-a749-cc8fffe6b72d tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:46.866386 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-71c0e4f7-4e38-4223-af4b-be07b2fd20a6 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] 10.222.0.47 "POST /compute/v2.1/servers/798b77ff-c3ca-4c65-a120-db12ad953621/action" status: 200 len: 36305 microversion: 2.20 time: 0.360685 Feb 19 05:01:46.876233 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 135/285] 10.222.0.47 () {62 vars in 1309 bytes} [Fri Feb 19 05:01:46 2021] POST /compute/v2.1/servers/798b77ff-c3ca-4c65-a120-db12ad953621/action => generated 36305 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 19 05:01:46.890216 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-fd6a8c61-395e-433f-9543-b6cc2830afbf tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:01:46.892042 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-fd6a8c61-395e-433f-9543-b6cc2830afbf tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] [instance: 0d55dde2-c4d7-4da3-9f14-2e6a30f69bcb] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:01:46.913852 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-fd6a8c61-395e-433f-9543-b6cc2830afbf tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:46.914943 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-fd6a8c61-395e-433f-9543-b6cc2830afbf tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:46.916669 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-fd6a8c61-395e-433f-9543-b6cc2830afbf tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:46.917940 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-fd6a8c61-395e-433f-9543-b6cc2830afbf tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:47.096501 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-0afd0ed1-0e0d-4e2b-a749-cc8fffe6b72d tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ac58c346fa4d569782f22a3394e22a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f6827c056bf4dc0b68a527187f4be9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:01:47.117101 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-0afd0ed1-0e0d-4e2b-a749-cc8fffe6b72d tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] 10.222.0.47 "GET /compute/v2.1/servers/68e65823-58dc-4f2f-b814-bdd12dee87ad" status: 200 len: 1265 microversion: 2.1 time: 0.454939 Feb 19 05:01:47.118265 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 151/286] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:01:46 2021] GET /compute/v2.1/servers/68e65823-58dc-4f2f-b814-bdd12dee87ad => generated 1265 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:01:47.160971 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [req-cab8966d-963a-4457-8e20-779c628629a5 req-1aeb7133-c06e-4aa8-b89e-9c467ace525d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d55dde2-c4d7-4da3-9f14-2e6a30f69bcb", "tag": "7f6db7b2-7376-4015-ac0e-ba0a99929fb4"}]} {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:01:47.162783 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 05:01:47.162783 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: warnings.warn(msg) Feb 19 05:01:47.191412 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [req-cab8966d-963a-4457-8e20-779c628629a5 req-1aeb7133-c06e-4aa8-b89e-9c467ace525d service nova] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:47.192271 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [req-cab8966d-963a-4457-8e20-779c628629a5 req-1aeb7133-c06e-4aa8-b89e-9c467ace525d service nova] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:47.243268 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.compute.server_external_events [req-cab8966d-963a-4457-8e20-779c628629a5 req-1aeb7133-c06e-4aa8-b89e-9c467ace525d service nova] Creating event network-changed:7f6db7b2-7376-4015-ac0e-ba0a99929fb4 for instance 0d55dde2-c4d7-4da3-9f14-2e6a30f69bcb on hv-cinder-77642 Feb 19 05:01:47.252725 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [req-cab8966d-963a-4457-8e20-779c628629a5 req-1aeb7133-c06e-4aa8-b89e-9c467ace525d service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110847 Feb 19 05:01:47.254252 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 152/287] 10.222.0.47 () {64 vars in 1308 bytes} [Fri Feb 19 05:01:47 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 05:01:47.320405 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-8c00823f-59ff-4c03-a7df-edfb69afb984 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:01:47.321383 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-8c00823f-59ff-4c03-a7df-edfb69afb984 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] [instance: 74c5a115-b174-49fe-9b75-574e484a09e2] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:01:47.336173 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-8c00823f-59ff-4c03-a7df-edfb69afb984 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:47.343321 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-8c00823f-59ff-4c03-a7df-edfb69afb984 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:47.344475 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-8c00823f-59ff-4c03-a7df-edfb69afb984 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:47.349344 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-8c00823f-59ff-4c03-a7df-edfb69afb984 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:47.922368 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-fd6a8c61-395e-433f-9543-b6cc2830afbf tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '876d82b7755b4c1f91c8ad200c0f567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b461024d8cdf4d5c966d746682381d79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:01:48.005284 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-fd6a8c61-395e-433f-9543-b6cc2830afbf tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] 10.222.0.47 "GET /compute/v2.1/servers/0d55dde2-c4d7-4da3-9f14-2e6a30f69bcb" status: 200 len: 1318 microversion: 2.1 time: 1.123674 Feb 19 05:01:48.021160 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 136/288] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:01:46 2021] GET /compute/v2.1/servers/0d55dde2-c4d7-4da3-9f14-2e6a30f69bcb => generated 1318 bytes in 1144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:01:48.042538 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-acb240d4-f3e8-4260-ad31-af9e7ef88c94 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:01:48.045509 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-acb240d4-f3e8-4260-ad31-af9e7ef88c94 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] [instance: be65ea57-bc8d-4bce-80c3-33d8b6007ed1] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:01:48.066542 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-acb240d4-f3e8-4260-ad31-af9e7ef88c94 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:48.067903 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-acb240d4-f3e8-4260-ad31-af9e7ef88c94 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:48.069823 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-acb240d4-f3e8-4260-ad31-af9e7ef88c94 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:48.071221 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-acb240d4-f3e8-4260-ad31-af9e7ef88c94 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:48.094514 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-8c00823f-59ff-4c03-a7df-edfb69afb984 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24af0562e2aa43ca9d601be5e16fe9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ee9a43087d5497da3af9fbf68c4572d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:01:48.108994 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-8c00823f-59ff-4c03-a7df-edfb69afb984 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] 10.222.0.47 "GET /compute/v2.1/servers/74c5a115-b174-49fe-9b75-574e484a09e2" status: 200 len: 1519 microversion: 2.1 time: 0.795373 Feb 19 05:01:48.122622 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 153/289] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:01:47 2021] GET /compute/v2.1/servers/74c5a115-b174-49fe-9b75-574e484a09e2 => generated 1519 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 05:01:48.130125 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-68e8da02-869f-493f-9ff9-62c1c9504dce tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:01:48.131511 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-68e8da02-869f-493f-9ff9-62c1c9504dce tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] [instance: 798b77ff-c3ca-4c65-a120-db12ad953621] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:01:48.144126 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-68e8da02-869f-493f-9ff9-62c1c9504dce tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:48.145028 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-68e8da02-869f-493f-9ff9-62c1c9504dce tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:48.145948 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-68e8da02-869f-493f-9ff9-62c1c9504dce tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:48.149583 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-68e8da02-869f-493f-9ff9-62c1c9504dce tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:48.396728 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-68e8da02-869f-493f-9ff9-62c1c9504dce tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] 10.222.0.47 "POST /compute/v2.1/servers/798b77ff-c3ca-4c65-a120-db12ad953621/action" status: 200 len: 37393 microversion: 2.20 time: 0.272480 Feb 19 05:01:48.398527 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 154/290] 10.222.0.47 () {62 vars in 1309 bytes} [Fri Feb 19 05:01:48 2021] POST /compute/v2.1/servers/798b77ff-c3ca-4c65-a120-db12ad953621/action => generated 37393 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 19 05:01:48.413893 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-b1ea1edd-b33a-4149-80fe-9609eb60e861 tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:01:48.416323 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-b1ea1edd-b33a-4149-80fe-9609eb60e861 tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] [instance: 68e65823-58dc-4f2f-b814-bdd12dee87ad] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:01:48.428078 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-b1ea1edd-b33a-4149-80fe-9609eb60e861 tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:48.428561 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-b1ea1edd-b33a-4149-80fe-9609eb60e861 tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:48.429446 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-b1ea1edd-b33a-4149-80fe-9609eb60e861 tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:48.430027 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-b1ea1edd-b33a-4149-80fe-9609eb60e861 tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:48.441836 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-acb240d4-f3e8-4260-ad31-af9e7ef88c94 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] 10.222.0.47 "POST /compute/v2.1/servers/be65ea57-bc8d-4bce-80c3-33d8b6007ed1/action" status: 200 len: 31606 microversion: 2.1 time: 0.416759 Feb 19 05:01:48.442678 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 137/291] 10.222.0.47 () {60 vars in 1268 bytes} [Fri Feb 19 05:01:48 2021] POST /compute/v2.1/servers/be65ea57-bc8d-4bce-80c3-33d8b6007ed1/action => generated 31606 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 19 05:01:48.649051 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-b1ea1edd-b33a-4149-80fe-9609eb60e861 tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ac58c346fa4d569782f22a3394e22a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f6827c056bf4dc0b68a527187f4be9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:01:48.663188 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-b1ea1edd-b33a-4149-80fe-9609eb60e861 tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] 10.222.0.47 "GET /compute/v2.1/servers/68e65823-58dc-4f2f-b814-bdd12dee87ad" status: 200 len: 1271 microversion: 2.1 time: 0.262694 Feb 19 05:01:48.667441 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 155/292] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:01:48 2021] GET /compute/v2.1/servers/68e65823-58dc-4f2f-b814-bdd12dee87ad => generated 1271 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:01:49.040923 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-8d484627-f09c-47f3-899c-6441261f7ae0 tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:01:49.041767 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-8d484627-f09c-47f3-899c-6441261f7ae0 tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] [instance: 0d55dde2-c4d7-4da3-9f14-2e6a30f69bcb] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:01:49.051974 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-8d484627-f09c-47f3-899c-6441261f7ae0 tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:49.052568 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-8d484627-f09c-47f3-899c-6441261f7ae0 tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:49.053564 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-8d484627-f09c-47f3-899c-6441261f7ae0 tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:49.054077 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-8d484627-f09c-47f3-899c-6441261f7ae0 tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:49.137920 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-5030e816-5311-4d6d-a6dd-e65381717fa9 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:01:49.140848 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-5030e816-5311-4d6d-a6dd-e65381717fa9 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] [instance: 74c5a115-b174-49fe-9b75-574e484a09e2] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:01:49.158365 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-5030e816-5311-4d6d-a6dd-e65381717fa9 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:49.161501 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-5030e816-5311-4d6d-a6dd-e65381717fa9 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:49.163466 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-5030e816-5311-4d6d-a6dd-e65381717fa9 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:49.164500 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-5030e816-5311-4d6d-a6dd-e65381717fa9 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:49.749786 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-8d484627-f09c-47f3-899c-6441261f7ae0 tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '876d82b7755b4c1f91c8ad200c0f567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b461024d8cdf4d5c966d746682381d79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:01:49.774584 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-8d484627-f09c-47f3-899c-6441261f7ae0 tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] 10.222.0.47 "GET /compute/v2.1/servers/0d55dde2-c4d7-4da3-9f14-2e6a30f69bcb" status: 200 len: 1318 microversion: 2.1 time: 0.738232 Feb 19 05:01:49.776453 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 138/293] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:01:49 2021] GET /compute/v2.1/servers/0d55dde2-c4d7-4da3-9f14-2e6a30f69bcb => generated 1318 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:01:49.786866 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-81da3426-6a76-43d0-a116-ff328aabad69 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:01:49.789305 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-81da3426-6a76-43d0-a116-ff328aabad69 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] [instance: 798b77ff-c3ca-4c65-a120-db12ad953621] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:01:49.807199 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-81da3426-6a76-43d0-a116-ff328aabad69 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:49.808861 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-81da3426-6a76-43d0-a116-ff328aabad69 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:49.810950 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-81da3426-6a76-43d0-a116-ff328aabad69 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:49.812456 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-81da3426-6a76-43d0-a116-ff328aabad69 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:50.037446 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-5030e816-5311-4d6d-a6dd-e65381717fa9 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24af0562e2aa43ca9d601be5e16fe9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ee9a43087d5497da3af9fbf68c4572d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:01:50.048675 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-5030e816-5311-4d6d-a6dd-e65381717fa9 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] 10.222.0.47 "GET /compute/v2.1/servers/74c5a115-b174-49fe-9b75-574e484a09e2" status: 200 len: 1519 microversion: 2.1 time: 0.921240 Feb 19 05:01:50.049927 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-81da3426-6a76-43d0-a116-ff328aabad69 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] 10.222.0.47 "POST /compute/v2.1/servers/798b77ff-c3ca-4c65-a120-db12ad953621/action" status: 200 len: 38183 microversion: 2.20 time: 0.270678 Feb 19 05:01:50.051412 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 139/294] 10.222.0.47 () {62 vars in 1309 bytes} [Fri Feb 19 05:01:49 2021] POST /compute/v2.1/servers/798b77ff-c3ca-4c65-a120-db12ad953621/action => generated 38183 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 19 05:01:50.064331 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 156/295] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:01:49 2021] GET /compute/v2.1/servers/74c5a115-b174-49fe-9b75-574e484a09e2 => generated 1519 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:01:50.067895 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-12096826-d726-447b-ae56-813c35cd1b33 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:01:50.071755 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-e54ca993-ab58-4123-8a7d-3b543844c04e tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:01:50.072479 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-e54ca993-ab58-4123-8a7d-3b543844c04e tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] [instance: 68e65823-58dc-4f2f-b814-bdd12dee87ad] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:01:50.073784 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-12096826-d726-447b-ae56-813c35cd1b33 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] [instance: be65ea57-bc8d-4bce-80c3-33d8b6007ed1] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:01:50.094918 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-12096826-d726-447b-ae56-813c35cd1b33 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:50.097542 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-e54ca993-ab58-4123-8a7d-3b543844c04e tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:50.098094 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-e54ca993-ab58-4123-8a7d-3b543844c04e tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:50.098916 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-e54ca993-ab58-4123-8a7d-3b543844c04e tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:50.099233 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-12096826-d726-447b-ae56-813c35cd1b33 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:50.099404 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-e54ca993-ab58-4123-8a7d-3b543844c04e tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:50.100490 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-12096826-d726-447b-ae56-813c35cd1b33 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:50.102431 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-12096826-d726-447b-ae56-813c35cd1b33 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:50.381329 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-12096826-d726-447b-ae56-813c35cd1b33 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] 10.222.0.47 "POST /compute/v2.1/servers/be65ea57-bc8d-4bce-80c3-33d8b6007ed1/action" status: 200 len: 32287 microversion: 2.1 time: 0.325559 Feb 19 05:01:50.390462 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 140/296] 10.222.0.47 () {60 vars in 1268 bytes} [Fri Feb 19 05:01:50 2021] POST /compute/v2.1/servers/be65ea57-bc8d-4bce-80c3-33d8b6007ed1/action => generated 32287 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 19 05:01:50.433753 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-e54ca993-ab58-4123-8a7d-3b543844c04e tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ac58c346fa4d569782f22a3394e22a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f6827c056bf4dc0b68a527187f4be9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:01:50.446361 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-e54ca993-ab58-4123-8a7d-3b543844c04e tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] 10.222.0.47 "GET /compute/v2.1/servers/68e65823-58dc-4f2f-b814-bdd12dee87ad" status: 200 len: 1313 microversion: 2.1 time: 0.379799 Feb 19 05:01:50.447580 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 157/297] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:01:50 2021] GET /compute/v2.1/servers/68e65823-58dc-4f2f-b814-bdd12dee87ad => generated 1313 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:01:50.808005 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-fcb03154-06f7-4a4f-81c4-a75e95eb8eef tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:01:50.808784 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-fcb03154-06f7-4a4f-81c4-a75e95eb8eef tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] [instance: 0d55dde2-c4d7-4da3-9f14-2e6a30f69bcb] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:01:50.818824 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-fcb03154-06f7-4a4f-81c4-a75e95eb8eef tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:50.819537 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-fcb03154-06f7-4a4f-81c4-a75e95eb8eef tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:50.820456 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-fcb03154-06f7-4a4f-81c4-a75e95eb8eef tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:50.820945 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-fcb03154-06f7-4a4f-81c4-a75e95eb8eef tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:51.071431 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-8f3a6ec2-6d05-4e2d-bebd-dc6a123f5c8f tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:01:51.073335 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-8f3a6ec2-6d05-4e2d-bebd-dc6a123f5c8f tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] [instance: 798b77ff-c3ca-4c65-a120-db12ad953621] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:01:51.082342 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-fcb03154-06f7-4a4f-81c4-a75e95eb8eef tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '876d82b7755b4c1f91c8ad200c0f567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b461024d8cdf4d5c966d746682381d79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:01:51.095855 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-8f3a6ec2-6d05-4e2d-bebd-dc6a123f5c8f tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:51.096365 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-8f3a6ec2-6d05-4e2d-bebd-dc6a123f5c8f tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:51.098227 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-8f3a6ec2-6d05-4e2d-bebd-dc6a123f5c8f tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:51.098916 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-8f3a6ec2-6d05-4e2d-bebd-dc6a123f5c8f tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:51.101686 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-fcb03154-06f7-4a4f-81c4-a75e95eb8eef tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] 10.222.0.47 "GET /compute/v2.1/servers/0d55dde2-c4d7-4da3-9f14-2e6a30f69bcb" status: 200 len: 1318 microversion: 2.1 time: 0.299972 Feb 19 05:01:51.115009 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 141/298] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:01:50 2021] GET /compute/v2.1/servers/0d55dde2-c4d7-4da3-9f14-2e6a30f69bcb => generated 1318 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:01:51.121308 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-e836cdd9-8634-469e-8918-6bfe5c4c34f6 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:01:51.122316 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-e836cdd9-8634-469e-8918-6bfe5c4c34f6 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] [instance: 74c5a115-b174-49fe-9b75-574e484a09e2] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:01:51.133419 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-e836cdd9-8634-469e-8918-6bfe5c4c34f6 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:51.134024 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-e836cdd9-8634-469e-8918-6bfe5c4c34f6 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:51.135467 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-e836cdd9-8634-469e-8918-6bfe5c4c34f6 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:51.136193 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-e836cdd9-8634-469e-8918-6bfe5c4c34f6 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:51.288222 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-8f3a6ec2-6d05-4e2d-bebd-dc6a123f5c8f tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] 10.222.0.47 "POST /compute/v2.1/servers/798b77ff-c3ca-4c65-a120-db12ad953621/action" status: 200 len: 38183 microversion: 2.20 time: 0.222836 Feb 19 05:01:51.289360 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 158/299] 10.222.0.47 () {62 vars in 1309 bytes} [Fri Feb 19 05:01:51 2021] POST /compute/v2.1/servers/798b77ff-c3ca-4c65-a120-db12ad953621/action => generated 38183 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 19 05:01:51.385721 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-e836cdd9-8634-469e-8918-6bfe5c4c34f6 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24af0562e2aa43ca9d601be5e16fe9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ee9a43087d5497da3af9fbf68c4572d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:01:51.396302 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-e836cdd9-8634-469e-8918-6bfe5c4c34f6 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] 10.222.0.47 "GET /compute/v2.1/servers/74c5a115-b174-49fe-9b75-574e484a09e2" status: 200 len: 1519 microversion: 2.1 time: 0.279604 Feb 19 05:01:51.397238 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 142/300] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:01:51 2021] GET /compute/v2.1/servers/74c5a115-b174-49fe-9b75-574e484a09e2 => generated 1519 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:01:51.400723 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-8e5dc538-9756-4871-a79c-0be06d58005d tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:01:51.402227 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-8e5dc538-9756-4871-a79c-0be06d58005d tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] [instance: be65ea57-bc8d-4bce-80c3-33d8b6007ed1] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:01:51.417259 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-8e5dc538-9756-4871-a79c-0be06d58005d tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:51.418212 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-8e5dc538-9756-4871-a79c-0be06d58005d tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:51.419833 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-8e5dc538-9756-4871-a79c-0be06d58005d tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:51.421059 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-8e5dc538-9756-4871-a79c-0be06d58005d tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:51.468629 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-ab960589-7b9a-4007-91da-907a0eefb4db tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:01:51.469790 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-ab960589-7b9a-4007-91da-907a0eefb4db tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] [instance: 68e65823-58dc-4f2f-b814-bdd12dee87ad] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:01:51.485279 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-ab960589-7b9a-4007-91da-907a0eefb4db tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:51.486173 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-ab960589-7b9a-4007-91da-907a0eefb4db tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:51.488721 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-ab960589-7b9a-4007-91da-907a0eefb4db tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:51.489347 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-ab960589-7b9a-4007-91da-907a0eefb4db tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:51.683405 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-8e5dc538-9756-4871-a79c-0be06d58005d tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] 10.222.0.47 "POST /compute/v2.1/servers/be65ea57-bc8d-4bce-80c3-33d8b6007ed1/action" status: 200 len: 32911 microversion: 2.1 time: 0.287674 Feb 19 05:01:51.683732 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 159/301] 10.222.0.47 () {60 vars in 1268 bytes} [Fri Feb 19 05:01:51 2021] POST /compute/v2.1/servers/be65ea57-bc8d-4bce-80c3-33d8b6007ed1/action => generated 32911 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 19 05:01:51.694857 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [req-a88374f4-4561-4993-8fa3-43327be749e0 req-882f173e-943a-4701-951d-06444f6fa4fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "68e65823-58dc-4f2f-b814-bdd12dee87ad", "tag": "c64c00ef-0601-4ce8-827f-7c769d727b0d"}]} {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:01:51.696612 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 05:01:51.696612 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: warnings.warn(msg) Feb 19 05:01:51.708017 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [req-a88374f4-4561-4993-8fa3-43327be749e0 req-882f173e-943a-4701-951d-06444f6fa4fe service nova] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:51.708571 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [req-a88374f4-4561-4993-8fa3-43327be749e0 req-882f173e-943a-4701-951d-06444f6fa4fe service nova] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:51.731385 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.compute.server_external_events [req-a88374f4-4561-4993-8fa3-43327be749e0 req-882f173e-943a-4701-951d-06444f6fa4fe service nova] Creating event network-changed:c64c00ef-0601-4ce8-827f-7c769d727b0d for instance 68e65823-58dc-4f2f-b814-bdd12dee87ad on hv-cinder-77642 Feb 19 05:01:51.740472 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [req-a88374f4-4561-4993-8fa3-43327be749e0 req-882f173e-943a-4701-951d-06444f6fa4fe service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048135 Feb 19 05:01:51.741203 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 160/302] 10.222.0.47 () {64 vars in 1308 bytes} [Fri Feb 19 05:01:51 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 05:01:51.805243 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-ab960589-7b9a-4007-91da-907a0eefb4db tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ac58c346fa4d569782f22a3394e22a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f6827c056bf4dc0b68a527187f4be9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:01:51.816056 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-ab960589-7b9a-4007-91da-907a0eefb4db tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] 10.222.0.47 "GET /compute/v2.1/servers/68e65823-58dc-4f2f-b814-bdd12dee87ad" status: 200 len: 1313 microversion: 2.1 time: 0.354146 Feb 19 05:01:51.821322 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 143/303] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:01:51 2021] GET /compute/v2.1/servers/68e65823-58dc-4f2f-b814-bdd12dee87ad => generated 1313 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 05:01:52.128242 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-308f1fbc-8a38-4298-b8a8-3a496bbf28dc tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:01:52.129735 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-308f1fbc-8a38-4298-b8a8-3a496bbf28dc tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] [instance: 0d55dde2-c4d7-4da3-9f14-2e6a30f69bcb] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:01:52.146366 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-308f1fbc-8a38-4298-b8a8-3a496bbf28dc tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:52.147263 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-308f1fbc-8a38-4298-b8a8-3a496bbf28dc tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:52.148862 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-308f1fbc-8a38-4298-b8a8-3a496bbf28dc tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:52.149745 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-308f1fbc-8a38-4298-b8a8-3a496bbf28dc tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:52.310492 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-e94c81d7-6c8b-4801-ac4c-2815ccf94693 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:01:52.313157 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-e94c81d7-6c8b-4801-ac4c-2815ccf94693 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] [instance: 798b77ff-c3ca-4c65-a120-db12ad953621] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:01:52.331251 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-e94c81d7-6c8b-4801-ac4c-2815ccf94693 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:52.332206 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-e94c81d7-6c8b-4801-ac4c-2815ccf94693 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:52.333949 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-e94c81d7-6c8b-4801-ac4c-2815ccf94693 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:52.335168 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-e94c81d7-6c8b-4801-ac4c-2815ccf94693 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:52.476481 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-308f1fbc-8a38-4298-b8a8-3a496bbf28dc tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '876d82b7755b4c1f91c8ad200c0f567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b461024d8cdf4d5c966d746682381d79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:01:52.486287 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-308f1fbc-8a38-4298-b8a8-3a496bbf28dc tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] 10.222.0.47 "GET /compute/v2.1/servers/0d55dde2-c4d7-4da3-9f14-2e6a30f69bcb" status: 200 len: 1318 microversion: 2.1 time: 0.367415 Feb 19 05:01:52.486955 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 161/304] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:01:52 2021] GET /compute/v2.1/servers/0d55dde2-c4d7-4da3-9f14-2e6a30f69bcb => generated 1318 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:01:52.492536 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-e7265af0-c54c-4e87-9a7b-eefcd9aef188 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:01:52.493466 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-e7265af0-c54c-4e87-9a7b-eefcd9aef188 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] [instance: 74c5a115-b174-49fe-9b75-574e484a09e2] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:01:52.502634 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-e7265af0-c54c-4e87-9a7b-eefcd9aef188 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:52.503538 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-e7265af0-c54c-4e87-9a7b-eefcd9aef188 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:52.504397 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-e7265af0-c54c-4e87-9a7b-eefcd9aef188 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:52.505066 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-e7265af0-c54c-4e87-9a7b-eefcd9aef188 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:52.535852 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-e94c81d7-6c8b-4801-ac4c-2815ccf94693 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] 10.222.0.47 "POST /compute/v2.1/servers/798b77ff-c3ca-4c65-a120-db12ad953621/action" status: 200 len: 38325 microversion: 2.20 time: 0.235139 Feb 19 05:01:52.537473 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 144/305] 10.222.0.47 () {62 vars in 1309 bytes} [Fri Feb 19 05:01:52 2021] POST /compute/v2.1/servers/798b77ff-c3ca-4c65-a120-db12ad953621/action => generated 38325 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 19 05:01:52.553602 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-4866ca56-1ef9-4c40-93e4-fd28efe5d5c7 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:01:52.554786 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-4866ca56-1ef9-4c40-93e4-fd28efe5d5c7 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] [instance: 798b77ff-c3ca-4c65-a120-db12ad953621] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:01:52.569660 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-4866ca56-1ef9-4c40-93e4-fd28efe5d5c7 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:52.570471 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-4866ca56-1ef9-4c40-93e4-fd28efe5d5c7 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:52.572550 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-4866ca56-1ef9-4c40-93e4-fd28efe5d5c7 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:52.573015 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-4866ca56-1ef9-4c40-93e4-fd28efe5d5c7 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:52.643196 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-4866ca56-1ef9-4c40-93e4-fd28efe5d5c7 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] 10.222.0.47 "GET /compute/v2.1/servers/798b77ff-c3ca-4c65-a120-db12ad953621/ips" status: 200 len: 152 microversion: 2.20 time: 0.098446 Feb 19 05:01:52.643990 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 145/306] 10.222.0.47 () {60 vars in 1279 bytes} [Fri Feb 19 05:01:52 2021] GET /compute/v2.1/servers/798b77ff-c3ca-4c65-a120-db12ad953621/ips => generated 152 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 19 05:01:52.700937 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-8811458f-f18b-4655-90b5-81a3e30e062e tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:01:52.703228 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-8811458f-f18b-4655-90b5-81a3e30e062e tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] [instance: be65ea57-bc8d-4bce-80c3-33d8b6007ed1] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:01:52.721371 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-8811458f-f18b-4655-90b5-81a3e30e062e tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:52.722764 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-8811458f-f18b-4655-90b5-81a3e30e062e tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:52.724744 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-8811458f-f18b-4655-90b5-81a3e30e062e tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:52.738221 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-8811458f-f18b-4655-90b5-81a3e30e062e tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:52.826743 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-e7265af0-c54c-4e87-9a7b-eefcd9aef188 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24af0562e2aa43ca9d601be5e16fe9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ee9a43087d5497da3af9fbf68c4572d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:01:52.836926 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-e7265af0-c54c-4e87-9a7b-eefcd9aef188 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] 10.222.0.47 "GET /compute/v2.1/servers/74c5a115-b174-49fe-9b75-574e484a09e2" status: 200 len: 1519 microversion: 2.1 time: 0.348050 Feb 19 05:01:52.837453 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 162/307] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:01:52 2021] GET /compute/v2.1/servers/74c5a115-b174-49fe-9b75-574e484a09e2 => generated 1519 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:01:52.842303 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-277a3399-20ce-484e-ad39-bf0dee73ab31 tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:01:52.842965 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-277a3399-20ce-484e-ad39-bf0dee73ab31 tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] [instance: 68e65823-58dc-4f2f-b814-bdd12dee87ad] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:01:52.852118 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-277a3399-20ce-484e-ad39-bf0dee73ab31 tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:52.852794 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-277a3399-20ce-484e-ad39-bf0dee73ab31 tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:52.853791 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-277a3399-20ce-484e-ad39-bf0dee73ab31 tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:52.854426 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-277a3399-20ce-484e-ad39-bf0dee73ab31 tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:52.925682 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-8811458f-f18b-4655-90b5-81a3e30e062e tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] 10.222.0.47 "POST /compute/v2.1/servers/be65ea57-bc8d-4bce-80c3-33d8b6007ed1/action" status: 200 len: 33402 microversion: 2.1 time: 0.232456 Feb 19 05:01:52.931235 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 146/308] 10.222.0.47 () {60 vars in 1268 bytes} [Fri Feb 19 05:01:52 2021] POST /compute/v2.1/servers/be65ea57-bc8d-4bce-80c3-33d8b6007ed1/action => generated 33402 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 19 05:01:53.236225 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-277a3399-20ce-484e-ad39-bf0dee73ab31 tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ac58c346fa4d569782f22a3394e22a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f6827c056bf4dc0b68a527187f4be9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:01:53.249145 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-277a3399-20ce-484e-ad39-bf0dee73ab31 tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] 10.222.0.47 "GET /compute/v2.1/servers/68e65823-58dc-4f2f-b814-bdd12dee87ad" status: 200 len: 1313 microversion: 2.1 time: 0.410530 Feb 19 05:01:53.250146 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 163/309] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:01:52 2021] GET /compute/v2.1/servers/68e65823-58dc-4f2f-b814-bdd12dee87ad => generated 1313 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:01:53.510573 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-4a8ee913-8746-432a-8db0-1aca6b34b159 tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:01:53.511377 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-4a8ee913-8746-432a-8db0-1aca6b34b159 tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] [instance: 0d55dde2-c4d7-4da3-9f14-2e6a30f69bcb] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:01:53.522934 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-4a8ee913-8746-432a-8db0-1aca6b34b159 tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:53.523756 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-4a8ee913-8746-432a-8db0-1aca6b34b159 tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:53.525267 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-4a8ee913-8746-432a-8db0-1aca6b34b159 tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:53.525963 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-4a8ee913-8746-432a-8db0-1aca6b34b159 tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:53.871005 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-7e95530f-0885-4156-961e-6277faa50f9f tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:01:53.872231 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-7e95530f-0885-4156-961e-6277faa50f9f tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] [instance: 74c5a115-b174-49fe-9b75-574e484a09e2] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:01:53.895684 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-7e95530f-0885-4156-961e-6277faa50f9f tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:53.895684 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-7e95530f-0885-4156-961e-6277faa50f9f tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:53.895684 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-7e95530f-0885-4156-961e-6277faa50f9f tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:53.895684 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-7e95530f-0885-4156-961e-6277faa50f9f tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:54.289288 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-4a8ee913-8746-432a-8db0-1aca6b34b159 tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '876d82b7755b4c1f91c8ad200c0f567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b461024d8cdf4d5c966d746682381d79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:01:54.299456 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-4a8ee913-8746-432a-8db0-1aca6b34b159 tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] 10.222.0.47 "GET /compute/v2.1/servers/0d55dde2-c4d7-4da3-9f14-2e6a30f69bcb" status: 200 len: 1318 microversion: 2.1 time: 0.794621 Feb 19 05:01:54.301294 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 147/310] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:01:53 2021] GET /compute/v2.1/servers/0d55dde2-c4d7-4da3-9f14-2e6a30f69bcb => generated 1318 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 05:01:54.306740 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-0911d9cb-231b-434c-a521-4d5b518ec1e5 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:01:54.308107 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-0911d9cb-231b-434c-a521-4d5b518ec1e5 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] [instance: be65ea57-bc8d-4bce-80c3-33d8b6007ed1] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:01:54.330077 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-0911d9cb-231b-434c-a521-4d5b518ec1e5 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:54.331235 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-0911d9cb-231b-434c-a521-4d5b518ec1e5 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:54.332846 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-0911d9cb-231b-434c-a521-4d5b518ec1e5 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:54.333494 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-0911d9cb-231b-434c-a521-4d5b518ec1e5 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:54.414391 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-7e95530f-0885-4156-961e-6277faa50f9f tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24af0562e2aa43ca9d601be5e16fe9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ee9a43087d5497da3af9fbf68c4572d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:01:54.429611 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-7e95530f-0885-4156-961e-6277faa50f9f tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] 10.222.0.47 "GET /compute/v2.1/servers/74c5a115-b174-49fe-9b75-574e484a09e2" status: 200 len: 1519 microversion: 2.1 time: 0.565865 Feb 19 05:01:54.442221 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 164/311] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:01:53 2021] GET /compute/v2.1/servers/74c5a115-b174-49fe-9b75-574e484a09e2 => generated 1519 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:01:54.447797 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-39a97cfb-f555-495a-b4d7-c0a0a82bc905 tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:01:54.448671 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-39a97cfb-f555-495a-b4d7-c0a0a82bc905 tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] [instance: 68e65823-58dc-4f2f-b814-bdd12dee87ad] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:01:54.457755 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-39a97cfb-f555-495a-b4d7-c0a0a82bc905 tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:54.459004 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-39a97cfb-f555-495a-b4d7-c0a0a82bc905 tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:54.460034 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-39a97cfb-f555-495a-b4d7-c0a0a82bc905 tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:54.460773 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-39a97cfb-f555-495a-b4d7-c0a0a82bc905 tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:54.636952 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-0911d9cb-231b-434c-a521-4d5b518ec1e5 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] 10.222.0.47 "POST /compute/v2.1/servers/be65ea57-bc8d-4bce-80c3-33d8b6007ed1/action" status: 200 len: 34636 microversion: 2.1 time: 0.334110 Feb 19 05:01:54.638318 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 148/312] 10.222.0.47 () {60 vars in 1268 bytes} [Fri Feb 19 05:01:54 2021] POST /compute/v2.1/servers/be65ea57-bc8d-4bce-80c3-33d8b6007ed1/action => generated 34636 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 19 05:01:54.686611 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [req-8fdcb539-7685-4466-90db-56e3a0ba411a req-e83091c9-b642-4eea-affa-6fcb8c2381cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d55dde2-c4d7-4da3-9f14-2e6a30f69bcb", "name": "network-vif-plugged", "status": "completed", "tag": "7f6db7b2-7376-4015-ac0e-ba0a99929fb4"}]} {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:01:54.688739 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 05:01:54.688739 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: warnings.warn(msg) Feb 19 05:01:54.701837 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [req-8fdcb539-7685-4466-90db-56e3a0ba411a req-e83091c9-b642-4eea-affa-6fcb8c2381cc service nova] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:54.702284 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [req-8fdcb539-7685-4466-90db-56e3a0ba411a req-e83091c9-b642-4eea-affa-6fcb8c2381cc service nova] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:54.757171 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.compute.server_external_events [req-8fdcb539-7685-4466-90db-56e3a0ba411a req-e83091c9-b642-4eea-affa-6fcb8c2381cc service nova] Creating event network-vif-plugged:7f6db7b2-7376-4015-ac0e-ba0a99929fb4 for instance 0d55dde2-c4d7-4da3-9f14-2e6a30f69bcb on hv-cinder-77642 Feb 19 05:01:54.763847 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [req-8fdcb539-7685-4466-90db-56e3a0ba411a req-e83091c9-b642-4eea-affa-6fcb8c2381cc service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082600 Feb 19 05:01:54.764900 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 149/313] 10.222.0.47 () {64 vars in 1308 bytes} [Fri Feb 19 05:01:54 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 05:01:54.804973 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-39a97cfb-f555-495a-b4d7-c0a0a82bc905 tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ac58c346fa4d569782f22a3394e22a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f6827c056bf4dc0b68a527187f4be9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:01:54.815016 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-39a97cfb-f555-495a-b4d7-c0a0a82bc905 tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] 10.222.0.47 "GET /compute/v2.1/servers/68e65823-58dc-4f2f-b814-bdd12dee87ad" status: 200 len: 1313 microversion: 2.1 time: 0.371233 Feb 19 05:01:54.819493 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 165/314] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:01:54 2021] GET /compute/v2.1/servers/68e65823-58dc-4f2f-b814-bdd12dee87ad => generated 1313 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:01:55.321054 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-8d32995c-d8ef-4c58-a51c-c9337f5e26cb tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:01:55.321819 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-8d32995c-d8ef-4c58-a51c-c9337f5e26cb tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] [instance: 0d55dde2-c4d7-4da3-9f14-2e6a30f69bcb] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:01:55.332043 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-8d32995c-d8ef-4c58-a51c-c9337f5e26cb tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:55.332714 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-8d32995c-d8ef-4c58-a51c-c9337f5e26cb tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:55.333625 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-8d32995c-d8ef-4c58-a51c-c9337f5e26cb tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:55.334126 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-8d32995c-d8ef-4c58-a51c-c9337f5e26cb tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:55.468553 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-ad17c3d0-b495-44f3-b272-701ef3963953 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:01:55.469928 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-ad17c3d0-b495-44f3-b272-701ef3963953 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] [instance: 74c5a115-b174-49fe-9b75-574e484a09e2] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:01:55.483792 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-ad17c3d0-b495-44f3-b272-701ef3963953 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:55.484697 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-ad17c3d0-b495-44f3-b272-701ef3963953 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:55.485777 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-ad17c3d0-b495-44f3-b272-701ef3963953 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:55.487004 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-ad17c3d0-b495-44f3-b272-701ef3963953 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:55.717367 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-8d32995c-d8ef-4c58-a51c-c9337f5e26cb tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '876d82b7755b4c1f91c8ad200c0f567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b461024d8cdf4d5c966d746682381d79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:01:55.741583 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-8d32995c-d8ef-4c58-a51c-c9337f5e26cb tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] 10.222.0.47 "GET /compute/v2.1/servers/0d55dde2-c4d7-4da3-9f14-2e6a30f69bcb" status: 200 len: 1318 microversion: 2.1 time: 0.426669 Feb 19 05:01:55.742244 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 150/315] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:01:55 2021] GET /compute/v2.1/servers/0d55dde2-c4d7-4da3-9f14-2e6a30f69bcb => generated 1318 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:01:55.747374 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-a7a36527-875e-427b-951c-4952f75777ec tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:01:55.758611 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-a7a36527-875e-427b-951c-4952f75777ec tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] [instance: be65ea57-bc8d-4bce-80c3-33d8b6007ed1] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:01:55.779547 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-a7a36527-875e-427b-951c-4952f75777ec tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:55.780436 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-a7a36527-875e-427b-951c-4952f75777ec tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:55.781926 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-a7a36527-875e-427b-951c-4952f75777ec tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:55.782836 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-a7a36527-875e-427b-951c-4952f75777ec tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:55.860022 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-ad17c3d0-b495-44f3-b272-701ef3963953 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24af0562e2aa43ca9d601be5e16fe9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ee9a43087d5497da3af9fbf68c4572d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:01:55.879064 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-ad17c3d0-b495-44f3-b272-701ef3963953 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] 10.222.0.47 "GET /compute/v2.1/servers/74c5a115-b174-49fe-9b75-574e484a09e2" status: 200 len: 1519 microversion: 2.1 time: 0.430003 Feb 19 05:01:55.883091 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 166/316] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:01:55 2021] GET /compute/v2.1/servers/74c5a115-b174-49fe-9b75-574e484a09e2 => generated 1519 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:01:55.892028 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-178e5c51-6a3e-4857-b528-51f4f5328c38 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4e40b0aa-5766-4740-aafe-bd71b380d261"}} {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:01:55.895687 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-178e5c51-6a3e-4857-b528-51f4f5328c38 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] [instance: 3aafde29-2f77-4921-9580-05730dd73604] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:01:55.913488 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-178e5c51-6a3e-4857-b528-51f4f5328c38 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:55.914771 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-178e5c51-6a3e-4857-b528-51f4f5328c38 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:55.925007 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-178e5c51-6a3e-4857-b528-51f4f5328c38 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:55.928270 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-178e5c51-6a3e-4857-b528-51f4f5328c38 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:56.079446 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-a7a36527-875e-427b-951c-4952f75777ec tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] 10.222.0.47 "POST /compute/v2.1/servers/be65ea57-bc8d-4bce-80c3-33d8b6007ed1/action" status: 200 len: 35334 microversion: 2.1 time: 0.335698 Feb 19 05:01:56.080482 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 151/317] 10.222.0.47 () {60 vars in 1268 bytes} [Fri Feb 19 05:01:55 2021] POST /compute/v2.1/servers/be65ea57-bc8d-4bce-80c3-33d8b6007ed1/action => generated 35334 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 19 05:01:56.089287 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-af90f1d6-ffd8-415b-8d22-8ec7bbf72424 tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:01:56.090750 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-af90f1d6-ffd8-415b-8d22-8ec7bbf72424 tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] [instance: 68e65823-58dc-4f2f-b814-bdd12dee87ad] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:01:56.103107 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-af90f1d6-ffd8-415b-8d22-8ec7bbf72424 tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:56.104023 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-af90f1d6-ffd8-415b-8d22-8ec7bbf72424 tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:56.105240 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-af90f1d6-ffd8-415b-8d22-8ec7bbf72424 tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:56.105965 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-af90f1d6-ffd8-415b-8d22-8ec7bbf72424 tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:56.241267 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.wsgi [None req-178e5c51-6a3e-4857-b528-51f4f5328c38 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] HTTP exception thrown: Invalid volume: volume 4e40b0aa-5766-4740-aafe-bd71b380d261 is already attached to instances: 3aafde29-2f77-4921-9580-05730dd73604 Feb 19 05:01:56.242471 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-178e5c51-6a3e-4857-b528-51f4f5328c38 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Returning 400 to user: Invalid volume: volume 4e40b0aa-5766-4740-aafe-bd71b380d261 is already attached to instances: 3aafde29-2f77-4921-9580-05730dd73604 {{(pid=98154) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 19 05:01:56.243754 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-178e5c51-6a3e-4857-b528-51f4f5328c38 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] 10.222.0.47 "POST /compute/v2.1/servers/3aafde29-2f77-4921-9580-05730dd73604/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.361401 Feb 19 05:01:56.244580 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 167/318] 10.222.0.47 () {60 vars in 1313 bytes} [Fri Feb 19 05:01:55 2021] POST /compute/v2.1/servers/3aafde29-2f77-4921-9580-05730dd73604/os-volume_attachments => generated 174 bytes in 363 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Feb 19 05:01:56.266573 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-931aa7e4-93c3-4d44-9608-c67572cf86f0 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:01:56.267506 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-931aa7e4-93c3-4d44-9608-c67572cf86f0 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] [instance: 798b77ff-c3ca-4c65-a120-db12ad953621] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:01:56.287958 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-931aa7e4-93c3-4d44-9608-c67572cf86f0 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:56.288700 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-931aa7e4-93c3-4d44-9608-c67572cf86f0 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:56.296723 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-931aa7e4-93c3-4d44-9608-c67572cf86f0 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:56.298323 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-931aa7e4-93c3-4d44-9608-c67572cf86f0 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:56.400772 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.objects.instance [None req-931aa7e4-93c3-4d44-9608-c67572cf86f0 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lazy-loading 'flavor' on Instance uuid 798b77ff-c3ca-4c65-a120-db12ad953621 {{(pid=98154) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Feb 19 05:01:56.486638 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-af90f1d6-ffd8-415b-8d22-8ec7bbf72424 tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ac58c346fa4d569782f22a3394e22a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f6827c056bf4dc0b68a527187f4be9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:01:56.500412 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-af90f1d6-ffd8-415b-8d22-8ec7bbf72424 tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] 10.222.0.47 "GET /compute/v2.1/servers/68e65823-58dc-4f2f-b814-bdd12dee87ad" status: 200 len: 1313 microversion: 2.1 time: 0.417440 Feb 19 05:01:56.501314 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 152/319] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:01:56 2021] GET /compute/v2.1/servers/68e65823-58dc-4f2f-b814-bdd12dee87ad => generated 1313 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:01:56.540136 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-b094b208-5b45-407c-976e-75ace434de11 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:01:56.540690 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-b094b208-5b45-407c-976e-75ace434de11 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] [instance: 3aafde29-2f77-4921-9580-05730dd73604] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:01:56.549404 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-b094b208-5b45-407c-976e-75ace434de11 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:56.549978 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-b094b208-5b45-407c-976e-75ace434de11 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:56.550873 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-b094b208-5b45-407c-976e-75ace434de11 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:56.551792 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-b094b208-5b45-407c-976e-75ace434de11 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:56.828307 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.objects.instance [None req-b094b208-5b45-407c-976e-75ace434de11 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lazy-loading 'services' on Instance uuid 3aafde29-2f77-4921-9580-05730dd73604 {{(pid=98153) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Feb 19 05:01:57.022470 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-b094b208-5b45-407c-976e-75ace434de11 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] 10.222.0.47 "DELETE /compute/v2.1/servers/3aafde29-2f77-4921-9580-05730dd73604/os-volume_attachments/4e40b0aa-5766-4740-aafe-bd71b380d261" status: 202 len: 0 microversion: 2.1 time: 0.485178 Feb 19 05:01:57.028041 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 153/320] 10.222.0.47 () {58 vars in 1406 bytes} [Fri Feb 19 05:01:56 2021] DELETE /compute/v2.1/servers/3aafde29-2f77-4921-9580-05730dd73604/os-volume_attachments/4e40b0aa-5766-4740-aafe-bd71b380d261 => generated 0 bytes in 494 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Feb 19 05:01:57.051533 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-476b6444-a328-4aa5-8017-eb19b4c95a01 tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:01:57.054803 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-476b6444-a328-4aa5-8017-eb19b4c95a01 tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] [instance: 0d55dde2-c4d7-4da3-9f14-2e6a30f69bcb] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:01:57.093907 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-476b6444-a328-4aa5-8017-eb19b4c95a01 tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:57.096069 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-476b6444-a328-4aa5-8017-eb19b4c95a01 tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:57.098469 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-476b6444-a328-4aa5-8017-eb19b4c95a01 tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:57.099927 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-476b6444-a328-4aa5-8017-eb19b4c95a01 tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:57.196745 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-931aa7e4-93c3-4d44-9608-c67572cf86f0 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] 10.222.0.47 "POST /compute/v2.1/servers/798b77ff-c3ca-4c65-a120-db12ad953621/action" status: 202 len: 0 microversion: 2.20 time: 0.949944 Feb 19 05:01:57.198233 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 168/321] 10.222.0.47 () {62 vars in 1309 bytes} [Fri Feb 19 05:01:56 2021] POST /compute/v2.1/servers/798b77ff-c3ca-4c65-a120-db12ad953621/action => generated 0 bytes in 953 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Feb 19 05:01:57.232306 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-a5fe3cfb-4ace-4ea9-bb1e-52c1e7adddd7 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:01:57.234216 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-a5fe3cfb-4ace-4ea9-bb1e-52c1e7adddd7 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] [instance: 74c5a115-b174-49fe-9b75-574e484a09e2] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:01:57.260212 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-a5fe3cfb-4ace-4ea9-bb1e-52c1e7adddd7 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:57.261553 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-a5fe3cfb-4ace-4ea9-bb1e-52c1e7adddd7 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:57.263202 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-a5fe3cfb-4ace-4ea9-bb1e-52c1e7adddd7 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:57.264133 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-a5fe3cfb-4ace-4ea9-bb1e-52c1e7adddd7 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:57.498797 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-476b6444-a328-4aa5-8017-eb19b4c95a01 tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '876d82b7755b4c1f91c8ad200c0f567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b461024d8cdf4d5c966d746682381d79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:01:57.519274 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-476b6444-a328-4aa5-8017-eb19b4c95a01 tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] 10.222.0.47 "GET /compute/v2.1/servers/0d55dde2-c4d7-4da3-9f14-2e6a30f69bcb" status: 200 len: 1506 microversion: 2.1 time: 0.488653 Feb 19 05:01:57.520506 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 154/322] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:01:57 2021] GET /compute/v2.1/servers/0d55dde2-c4d7-4da3-9f14-2e6a30f69bcb => generated 1506 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:01:57.530502 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-cd58dd29-3cf7-45c1-b1a8-2fb68c29513f tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:01:57.532682 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-cd58dd29-3cf7-45c1-b1a8-2fb68c29513f tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] [instance: be65ea57-bc8d-4bce-80c3-33d8b6007ed1] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:01:57.550244 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-cd58dd29-3cf7-45c1-b1a8-2fb68c29513f tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:57.551783 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-cd58dd29-3cf7-45c1-b1a8-2fb68c29513f tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:57.554305 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-cd58dd29-3cf7-45c1-b1a8-2fb68c29513f tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:57.555573 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-cd58dd29-3cf7-45c1-b1a8-2fb68c29513f tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:57.613651 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-a5fe3cfb-4ace-4ea9-bb1e-52c1e7adddd7 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24af0562e2aa43ca9d601be5e16fe9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ee9a43087d5497da3af9fbf68c4572d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:01:57.624416 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-a5fe3cfb-4ace-4ea9-bb1e-52c1e7adddd7 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] 10.222.0.47 "GET /compute/v2.1/servers/74c5a115-b174-49fe-9b75-574e484a09e2" status: 200 len: 1519 microversion: 2.1 time: 0.409134 Feb 19 05:01:57.625355 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 169/323] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:01:57 2021] GET /compute/v2.1/servers/74c5a115-b174-49fe-9b75-574e484a09e2 => generated 1519 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:01:57.631963 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-5e27c4ce-ceec-4281-8275-e791eccd4974 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:01:57.632831 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-5e27c4ce-ceec-4281-8275-e791eccd4974 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] [instance: 798b77ff-c3ca-4c65-a120-db12ad953621] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:01:57.646971 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-5e27c4ce-ceec-4281-8275-e791eccd4974 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:57.647562 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-5e27c4ce-ceec-4281-8275-e791eccd4974 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:57.648569 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-5e27c4ce-ceec-4281-8275-e791eccd4974 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:57.649161 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-5e27c4ce-ceec-4281-8275-e791eccd4974 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:57.961494 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-5e27c4ce-ceec-4281-8275-e791eccd4974 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:01:57.981615 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-5e27c4ce-ceec-4281-8275-e791eccd4974 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:01:57.985998 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-5e27c4ce-ceec-4281-8275-e791eccd4974 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:01:57.989068 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-5e27c4ce-ceec-4281-8275-e791eccd4974 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] 10.222.0.47 "GET /compute/v2.1/servers/798b77ff-c3ca-4c65-a120-db12ad953621" status: 200 len: 1725 microversion: 2.20 time: 0.361670 Feb 19 05:01:57.990385 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 170/324] 10.222.0.47 () {60 vars in 1267 bytes} [Fri Feb 19 05:01:57 2021] GET /compute/v2.1/servers/798b77ff-c3ca-4c65-a120-db12ad953621 => generated 1725 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 05:01:58.006618 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-4fea2024-32fe-4a2a-a64f-96940a86e572 tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:01:58.007209 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-4fea2024-32fe-4a2a-a64f-96940a86e572 tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] [instance: 68e65823-58dc-4f2f-b814-bdd12dee87ad] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:01:58.015972 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-4fea2024-32fe-4a2a-a64f-96940a86e572 tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:58.016473 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-4fea2024-32fe-4a2a-a64f-96940a86e572 tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:58.017328 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-4fea2024-32fe-4a2a-a64f-96940a86e572 tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:58.017811 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-4fea2024-32fe-4a2a-a64f-96940a86e572 tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:58.413739 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-4fea2024-32fe-4a2a-a64f-96940a86e572 tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ac58c346fa4d569782f22a3394e22a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f6827c056bf4dc0b68a527187f4be9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:01:58.431112 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-4fea2024-32fe-4a2a-a64f-96940a86e572 tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] 10.222.0.47 "GET /compute/v2.1/servers/68e65823-58dc-4f2f-b814-bdd12dee87ad" status: 200 len: 1313 microversion: 2.1 time: 0.428596 Feb 19 05:01:58.432658 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 171/325] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:01:57 2021] GET /compute/v2.1/servers/68e65823-58dc-4f2f-b814-bdd12dee87ad => generated 1313 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:01:58.652933 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-4fbf8111-f8ce-4829-ab49-3175a7f2a5d4 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:01:58.653606 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-4fbf8111-f8ce-4829-ab49-3175a7f2a5d4 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] [instance: 74c5a115-b174-49fe-9b75-574e484a09e2] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:01:58.663035 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-4fbf8111-f8ce-4829-ab49-3175a7f2a5d4 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:58.663694 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-4fbf8111-f8ce-4829-ab49-3175a7f2a5d4 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:58.664670 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-4fbf8111-f8ce-4829-ab49-3175a7f2a5d4 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:58.665226 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-4fbf8111-f8ce-4829-ab49-3175a7f2a5d4 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:58.907021 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-4fbf8111-f8ce-4829-ab49-3175a7f2a5d4 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24af0562e2aa43ca9d601be5e16fe9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ee9a43087d5497da3af9fbf68c4572d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:01:58.917963 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-4fbf8111-f8ce-4829-ab49-3175a7f2a5d4 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] 10.222.0.47 "GET /compute/v2.1/servers/74c5a115-b174-49fe-9b75-574e484a09e2" status: 200 len: 1519 microversion: 2.1 time: 0.268946 Feb 19 05:01:58.918617 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 172/326] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:01:58 2021] GET /compute/v2.1/servers/74c5a115-b174-49fe-9b75-574e484a09e2 => generated 1519 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 05:01:59.024540 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-ad5d8dda-a4fd-4cd3-acb5-78a6ee19e9e4 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:01:59.025270 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-ad5d8dda-a4fd-4cd3-acb5-78a6ee19e9e4 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] [instance: 798b77ff-c3ca-4c65-a120-db12ad953621] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:01:59.033912 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-ad5d8dda-a4fd-4cd3-acb5-78a6ee19e9e4 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:59.034678 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-ad5d8dda-a4fd-4cd3-acb5-78a6ee19e9e4 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:59.035857 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-ad5d8dda-a4fd-4cd3-acb5-78a6ee19e9e4 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:59.036409 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-ad5d8dda-a4fd-4cd3-acb5-78a6ee19e9e4 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:59.279282 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-ad5d8dda-a4fd-4cd3-acb5-78a6ee19e9e4 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:01:59.290307 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-ad5d8dda-a4fd-4cd3-acb5-78a6ee19e9e4 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:01:59.291963 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-ad5d8dda-a4fd-4cd3-acb5-78a6ee19e9e4 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:01:59.293261 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-ad5d8dda-a4fd-4cd3-acb5-78a6ee19e9e4 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] 10.222.0.47 "GET /compute/v2.1/servers/798b77ff-c3ca-4c65-a120-db12ad953621" status: 200 len: 1725 microversion: 2.20 time: 0.273546 Feb 19 05:01:59.293956 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 173/327] 10.222.0.47 () {60 vars in 1267 bytes} [Fri Feb 19 05:01:59 2021] GET /compute/v2.1/servers/798b77ff-c3ca-4c65-a120-db12ad953621 => generated 1725 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 19 05:01:59.463432 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-8d1ead7f-bd7b-4ac1-bd7a-1c5f0072c370 tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:01:59.464208 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-8d1ead7f-bd7b-4ac1-bd7a-1c5f0072c370 tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] [instance: 68e65823-58dc-4f2f-b814-bdd12dee87ad] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:01:59.473460 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-8d1ead7f-bd7b-4ac1-bd7a-1c5f0072c370 tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:59.473969 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-8d1ead7f-bd7b-4ac1-bd7a-1c5f0072c370 tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:59.474831 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-8d1ead7f-bd7b-4ac1-bd7a-1c5f0072c370 tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:59.475321 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-8d1ead7f-bd7b-4ac1-bd7a-1c5f0072c370 tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:59.744538 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-8d1ead7f-bd7b-4ac1-bd7a-1c5f0072c370 tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ac58c346fa4d569782f22a3394e22a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f6827c056bf4dc0b68a527187f4be9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:01:59.756737 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-8d1ead7f-bd7b-4ac1-bd7a-1c5f0072c370 tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] 10.222.0.47 "GET /compute/v2.1/servers/68e65823-58dc-4f2f-b814-bdd12dee87ad" status: 200 len: 1313 microversion: 2.1 time: 0.297233 Feb 19 05:01:59.767428 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 174/328] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:01:59 2021] GET /compute/v2.1/servers/68e65823-58dc-4f2f-b814-bdd12dee87ad => generated 1313 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:01:59.937862 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-162ab734-f2d0-4298-9656-1472efcca18d tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:01:59.938865 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-162ab734-f2d0-4298-9656-1472efcca18d tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] [instance: 74c5a115-b174-49fe-9b75-574e484a09e2] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:01:59.948355 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-162ab734-f2d0-4298-9656-1472efcca18d tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:59.948996 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-162ab734-f2d0-4298-9656-1472efcca18d tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:01:59.950134 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-162ab734-f2d0-4298-9656-1472efcca18d tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:01:59.950739 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-162ab734-f2d0-4298-9656-1472efcca18d tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:02:00.215790 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-162ab734-f2d0-4298-9656-1472efcca18d tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24af0562e2aa43ca9d601be5e16fe9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ee9a43087d5497da3af9fbf68c4572d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:02:00.226310 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-162ab734-f2d0-4298-9656-1472efcca18d tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] 10.222.0.47 "GET /compute/v2.1/servers/74c5a115-b174-49fe-9b75-574e484a09e2" status: 200 len: 1519 microversion: 2.1 time: 0.293102 Feb 19 05:02:00.226964 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 175/329] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:01:59 2021] GET /compute/v2.1/servers/74c5a115-b174-49fe-9b75-574e484a09e2 => generated 1519 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 05:02:00.314377 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-4107b295-3fcd-4c64-9ced-f352c2c2424b tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:02:00.315040 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-4107b295-3fcd-4c64-9ced-f352c2c2424b tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] [instance: 798b77ff-c3ca-4c65-a120-db12ad953621] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:02:00.323865 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-4107b295-3fcd-4c64-9ced-f352c2c2424b tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:02:00.324370 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-4107b295-3fcd-4c64-9ced-f352c2c2424b tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:02:00.325289 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-4107b295-3fcd-4c64-9ced-f352c2c2424b tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:02:00.325779 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-4107b295-3fcd-4c64-9ced-f352c2c2424b tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:02:00.528274 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-cd58dd29-3cf7-45c1-b1a8-2fb68c29513f tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] 10.222.0.47 "POST /compute/v2.1/servers/be65ea57-bc8d-4bce-80c3-33d8b6007ed1/action" status: 200 len: 38078 microversion: 2.1 time: 3.005255 Feb 19 05:02:00.529640 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 155/330] 10.222.0.47 () {60 vars in 1268 bytes} [Fri Feb 19 05:01:57 2021] POST /compute/v2.1/servers/be65ea57-bc8d-4bce-80c3-33d8b6007ed1/action => generated 38078 bytes in 3009 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 19 05:02:00.622363 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-4107b295-3fcd-4c64-9ced-f352c2c2424b tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:02:00.637937 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-4107b295-3fcd-4c64-9ced-f352c2c2424b tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:02:00.639852 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-4107b295-3fcd-4c64-9ced-f352c2c2424b tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:02:00.641560 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-4107b295-3fcd-4c64-9ced-f352c2c2424b tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] 10.222.0.47 "GET /compute/v2.1/servers/798b77ff-c3ca-4c65-a120-db12ad953621" status: 200 len: 1725 microversion: 2.20 time: 0.331175 Feb 19 05:02:00.642397 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 176/331] 10.222.0.47 () {60 vars in 1267 bytes} [Fri Feb 19 05:02:00 2021] GET /compute/v2.1/servers/798b77ff-c3ca-4c65-a120-db12ad953621 => generated 1725 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 19 05:02:00.837369 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-2e632f4a-a64d-423f-8ff4-121ca83f9272 tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:02:00.838551 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-2e632f4a-a64d-423f-8ff4-121ca83f9272 tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] [instance: 68e65823-58dc-4f2f-b814-bdd12dee87ad] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:02:00.849741 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-2e632f4a-a64d-423f-8ff4-121ca83f9272 tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:02:00.850252 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-2e632f4a-a64d-423f-8ff4-121ca83f9272 tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:02:00.851123 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-2e632f4a-a64d-423f-8ff4-121ca83f9272 tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:02:00.851648 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-2e632f4a-a64d-423f-8ff4-121ca83f9272 tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:02:01.141611 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-2e632f4a-a64d-423f-8ff4-121ca83f9272 tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ac58c346fa4d569782f22a3394e22a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f6827c056bf4dc0b68a527187f4be9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:02:01.151777 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-2e632f4a-a64d-423f-8ff4-121ca83f9272 tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] 10.222.0.47 "GET /compute/v2.1/servers/68e65823-58dc-4f2f-b814-bdd12dee87ad" status: 200 len: 1313 microversion: 2.1 time: 0.320972 Feb 19 05:02:01.152436 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 156/332] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:02:00 2021] GET /compute/v2.1/servers/68e65823-58dc-4f2f-b814-bdd12dee87ad => generated 1313 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:02:01.245194 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-8962742f-e4ab-4568-9fbf-fc45dc0af3bd tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:02:01.245874 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-8962742f-e4ab-4568-9fbf-fc45dc0af3bd tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] [instance: 74c5a115-b174-49fe-9b75-574e484a09e2] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:02:01.255545 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-8962742f-e4ab-4568-9fbf-fc45dc0af3bd tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:02:01.256059 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-8962742f-e4ab-4568-9fbf-fc45dc0af3bd tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:02:01.257195 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-8962742f-e4ab-4568-9fbf-fc45dc0af3bd tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:02:01.257705 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-8962742f-e4ab-4568-9fbf-fc45dc0af3bd tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:02:01.501289 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-8962742f-e4ab-4568-9fbf-fc45dc0af3bd tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24af0562e2aa43ca9d601be5e16fe9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ee9a43087d5497da3af9fbf68c4572d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:02:01.512170 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-8962742f-e4ab-4568-9fbf-fc45dc0af3bd tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] 10.222.0.47 "GET /compute/v2.1/servers/74c5a115-b174-49fe-9b75-574e484a09e2" status: 200 len: 1519 microversion: 2.1 time: 0.271094 Feb 19 05:02:01.512833 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 177/333] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:02:01 2021] GET /compute/v2.1/servers/74c5a115-b174-49fe-9b75-574e484a09e2 => generated 1519 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:02:01.544495 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-16acbe46-00f6-4647-b5fa-83d832a7debe tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:02:01.545664 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-16acbe46-00f6-4647-b5fa-83d832a7debe tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] [instance: be65ea57-bc8d-4bce-80c3-33d8b6007ed1] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:02:01.555215 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-16acbe46-00f6-4647-b5fa-83d832a7debe tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:02:01.555749 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-16acbe46-00f6-4647-b5fa-83d832a7debe tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:02:01.556651 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-16acbe46-00f6-4647-b5fa-83d832a7debe tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:02:01.557143 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-16acbe46-00f6-4647-b5fa-83d832a7debe tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:02:01.677257 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-24df0c1e-fd19-499d-982e-e93b64f2023d tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:02:01.678509 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-24df0c1e-fd19-499d-982e-e93b64f2023d tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] [instance: 798b77ff-c3ca-4c65-a120-db12ad953621] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:02:01.694958 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-24df0c1e-fd19-499d-982e-e93b64f2023d tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:02:01.695903 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-24df0c1e-fd19-499d-982e-e93b64f2023d tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:02:01.697488 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-24df0c1e-fd19-499d-982e-e93b64f2023d tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:02:01.698390 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-24df0c1e-fd19-499d-982e-e93b64f2023d tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:02:02.029854 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-24df0c1e-fd19-499d-982e-e93b64f2023d tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:02:02.050430 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-24df0c1e-fd19-499d-982e-e93b64f2023d tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:02:02.053818 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-24df0c1e-fd19-499d-982e-e93b64f2023d tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:02:02.056233 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-24df0c1e-fd19-499d-982e-e93b64f2023d tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] 10.222.0.47 "GET /compute/v2.1/servers/798b77ff-c3ca-4c65-a120-db12ad953621" status: 200 len: 1725 microversion: 2.20 time: 0.387579 Feb 19 05:02:02.057354 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 178/334] 10.222.0.47 () {60 vars in 1267 bytes} [Fri Feb 19 05:02:01 2021] GET /compute/v2.1/servers/798b77ff-c3ca-4c65-a120-db12ad953621 => generated 1725 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 19 05:02:02.170981 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-a3f07be0-c6b7-42c8-94a6-e953f06a59f2 tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:02:02.171722 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-a3f07be0-c6b7-42c8-94a6-e953f06a59f2 tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] [instance: 68e65823-58dc-4f2f-b814-bdd12dee87ad] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:02:02.180251 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-a3f07be0-c6b7-42c8-94a6-e953f06a59f2 tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:02:02.180756 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-a3f07be0-c6b7-42c8-94a6-e953f06a59f2 tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:02:02.181602 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-a3f07be0-c6b7-42c8-94a6-e953f06a59f2 tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:02:02.182097 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-a3f07be0-c6b7-42c8-94a6-e953f06a59f2 tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:02:02.421502 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-a3f07be0-c6b7-42c8-94a6-e953f06a59f2 tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ac58c346fa4d569782f22a3394e22a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f6827c056bf4dc0b68a527187f4be9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:02:02.431149 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-a3f07be0-c6b7-42c8-94a6-e953f06a59f2 tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] 10.222.0.47 "GET /compute/v2.1/servers/68e65823-58dc-4f2f-b814-bdd12dee87ad" status: 200 len: 1313 microversion: 2.1 time: 0.264287 Feb 19 05:02:02.431851 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 179/335] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:02:02 2021] GET /compute/v2.1/servers/68e65823-58dc-4f2f-b814-bdd12dee87ad => generated 1313 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 05:02:02.532771 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-a011e0b7-6429-48c7-b5d7-3aa17af4084b tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:02:02.533520 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-a011e0b7-6429-48c7-b5d7-3aa17af4084b tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] [instance: 74c5a115-b174-49fe-9b75-574e484a09e2] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:02:02.542708 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-a011e0b7-6429-48c7-b5d7-3aa17af4084b tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:02:02.543214 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-a011e0b7-6429-48c7-b5d7-3aa17af4084b tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:02:02.544131 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-a011e0b7-6429-48c7-b5d7-3aa17af4084b tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:02:02.544621 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-a011e0b7-6429-48c7-b5d7-3aa17af4084b tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:02:02.798487 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-a011e0b7-6429-48c7-b5d7-3aa17af4084b tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24af0562e2aa43ca9d601be5e16fe9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ee9a43087d5497da3af9fbf68c4572d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:02:02.809117 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-a011e0b7-6429-48c7-b5d7-3aa17af4084b tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] 10.222.0.47 "GET /compute/v2.1/servers/74c5a115-b174-49fe-9b75-574e484a09e2" status: 200 len: 1519 microversion: 2.1 time: 0.280385 Feb 19 05:02:02.809765 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 180/336] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:02:02 2021] GET /compute/v2.1/servers/74c5a115-b174-49fe-9b75-574e484a09e2 => generated 1519 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 05:02:03.084181 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-fee79102-3c10-49ad-ae00-17bab20d062a tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:02:03.084848 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-fee79102-3c10-49ad-ae00-17bab20d062a tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] [instance: 798b77ff-c3ca-4c65-a120-db12ad953621] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:02:03.093066 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-fee79102-3c10-49ad-ae00-17bab20d062a tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:02:03.093572 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-fee79102-3c10-49ad-ae00-17bab20d062a tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:02:03.094420 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-fee79102-3c10-49ad-ae00-17bab20d062a tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:02:03.094910 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-fee79102-3c10-49ad-ae00-17bab20d062a tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:02:03.356911 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-fee79102-3c10-49ad-ae00-17bab20d062a tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:02:03.367202 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-fee79102-3c10-49ad-ae00-17bab20d062a tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:02:03.369054 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-fee79102-3c10-49ad-ae00-17bab20d062a tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:02:03.370366 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-fee79102-3c10-49ad-ae00-17bab20d062a tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] 10.222.0.47 "GET /compute/v2.1/servers/798b77ff-c3ca-4c65-a120-db12ad953621" status: 200 len: 1725 microversion: 2.20 time: 0.290898 Feb 19 05:02:03.371068 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 181/337] 10.222.0.47 () {60 vars in 1267 bytes} [Fri Feb 19 05:02:03 2021] GET /compute/v2.1/servers/798b77ff-c3ca-4c65-a120-db12ad953621 => generated 1725 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 19 05:02:03.450096 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-ff9dbcc0-ab79-422a-8192-8c27a8b653a6 tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:02:03.450797 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-ff9dbcc0-ab79-422a-8192-8c27a8b653a6 tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] [instance: 68e65823-58dc-4f2f-b814-bdd12dee87ad] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:02:03.460858 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-ff9dbcc0-ab79-422a-8192-8c27a8b653a6 tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:02:03.461525 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-ff9dbcc0-ab79-422a-8192-8c27a8b653a6 tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:02:03.462457 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-ff9dbcc0-ab79-422a-8192-8c27a8b653a6 tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:02:03.463012 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-ff9dbcc0-ab79-422a-8192-8c27a8b653a6 tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:02:03.712519 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-ff9dbcc0-ab79-422a-8192-8c27a8b653a6 tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ac58c346fa4d569782f22a3394e22a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f6827c056bf4dc0b68a527187f4be9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:02:03.723085 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-ff9dbcc0-ab79-422a-8192-8c27a8b653a6 tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] 10.222.0.47 "GET /compute/v2.1/servers/68e65823-58dc-4f2f-b814-bdd12dee87ad" status: 200 len: 1313 microversion: 2.1 time: 0.276306 Feb 19 05:02:03.723818 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 182/338] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:02:03 2021] GET /compute/v2.1/servers/68e65823-58dc-4f2f-b814-bdd12dee87ad => generated 1313 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 05:02:03.828523 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-2d41fcbc-4951-4071-b5e3-35836c97b6ac tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:02:03.829224 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-2d41fcbc-4951-4071-b5e3-35836c97b6ac tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] [instance: 74c5a115-b174-49fe-9b75-574e484a09e2] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:02:03.839314 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-2d41fcbc-4951-4071-b5e3-35836c97b6ac tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:02:03.839870 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-2d41fcbc-4951-4071-b5e3-35836c97b6ac tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:02:03.840824 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-2d41fcbc-4951-4071-b5e3-35836c97b6ac tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:02:03.841321 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-2d41fcbc-4951-4071-b5e3-35836c97b6ac tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:02:04.142589 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-2d41fcbc-4951-4071-b5e3-35836c97b6ac tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24af0562e2aa43ca9d601be5e16fe9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ee9a43087d5497da3af9fbf68c4572d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:02:04.152855 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-2d41fcbc-4951-4071-b5e3-35836c97b6ac tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] 10.222.0.47 "GET /compute/v2.1/servers/74c5a115-b174-49fe-9b75-574e484a09e2" status: 200 len: 1519 microversion: 2.1 time: 0.328507 Feb 19 05:02:04.153513 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 183/339] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:02:03 2021] GET /compute/v2.1/servers/74c5a115-b174-49fe-9b75-574e484a09e2 => generated 1519 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:02:04.391023 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-d847c18b-14a8-4fc4-ae02-9ab33ea066a6 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:02:04.391761 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-d847c18b-14a8-4fc4-ae02-9ab33ea066a6 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] [instance: 798b77ff-c3ca-4c65-a120-db12ad953621] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:02:04.400557 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-d847c18b-14a8-4fc4-ae02-9ab33ea066a6 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:02:04.401062 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-d847c18b-14a8-4fc4-ae02-9ab33ea066a6 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:02:04.401905 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-d847c18b-14a8-4fc4-ae02-9ab33ea066a6 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:02:04.402390 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-d847c18b-14a8-4fc4-ae02-9ab33ea066a6 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:02:04.648686 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-d847c18b-14a8-4fc4-ae02-9ab33ea066a6 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:02:04.663149 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-d847c18b-14a8-4fc4-ae02-9ab33ea066a6 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:02:04.664867 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-d847c18b-14a8-4fc4-ae02-9ab33ea066a6 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:02:04.666137 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-d847c18b-14a8-4fc4-ae02-9ab33ea066a6 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] 10.222.0.47 "GET /compute/v2.1/servers/798b77ff-c3ca-4c65-a120-db12ad953621" status: 200 len: 1725 microversion: 2.20 time: 0.279433 Feb 19 05:02:04.666784 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 184/340] 10.222.0.47 () {60 vars in 1267 bytes} [Fri Feb 19 05:02:04 2021] GET /compute/v2.1/servers/798b77ff-c3ca-4c65-a120-db12ad953621 => generated 1725 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 19 05:02:04.741625 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-9ca640fb-0141-435f-b5d9-9517a9a59c47 tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:02:04.742294 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-9ca640fb-0141-435f-b5d9-9517a9a59c47 tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] [instance: 68e65823-58dc-4f2f-b814-bdd12dee87ad] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:02:04.750756 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-9ca640fb-0141-435f-b5d9-9517a9a59c47 tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:02:04.751259 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-9ca640fb-0141-435f-b5d9-9517a9a59c47 tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:02:04.752152 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-9ca640fb-0141-435f-b5d9-9517a9a59c47 tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:02:04.753191 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-9ca640fb-0141-435f-b5d9-9517a9a59c47 tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:02:04.860396 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-16acbe46-00f6-4647-b5fa-83d832a7debe tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] 10.222.0.47 "POST /compute/v2.1/servers/be65ea57-bc8d-4bce-80c3-33d8b6007ed1/action" status: 200 len: 38211 microversion: 2.1 time: 3.319519 Feb 19 05:02:04.861675 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 157/341] 10.222.0.47 () {60 vars in 1268 bytes} [Fri Feb 19 05:02:01 2021] POST /compute/v2.1/servers/be65ea57-bc8d-4bce-80c3-33d8b6007ed1/action => generated 38211 bytes in 3323 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 19 05:02:04.884129 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-dafe869b-8348-450d-b3e2-6a85814bcf9d tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:02:04.885916 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-dafe869b-8348-450d-b3e2-6a85814bcf9d tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] [instance: be65ea57-bc8d-4bce-80c3-33d8b6007ed1] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:02:04.898791 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-dafe869b-8348-450d-b3e2-6a85814bcf9d tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:02:04.899647 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-dafe869b-8348-450d-b3e2-6a85814bcf9d tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:02:04.900537 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-dafe869b-8348-450d-b3e2-6a85814bcf9d tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:02:04.901142 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-dafe869b-8348-450d-b3e2-6a85814bcf9d tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:02:04.984534 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-dafe869b-8348-450d-b3e2-6a85814bcf9d tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] 10.222.0.47 "GET /compute/v2.1/servers/be65ea57-bc8d-4bce-80c3-33d8b6007ed1/ips" status: 200 len: 146 microversion: 2.1 time: 0.110575 Feb 19 05:02:04.985452 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 158/342] 10.222.0.47 () {58 vars in 1238 bytes} [Fri Feb 19 05:02:04 2021] GET /compute/v2.1/servers/be65ea57-bc8d-4bce-80c3-33d8b6007ed1/ips => generated 146 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 19 05:02:05.019411 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-9ca640fb-0141-435f-b5d9-9517a9a59c47 tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ac58c346fa4d569782f22a3394e22a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f6827c056bf4dc0b68a527187f4be9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:02:05.030026 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-9ca640fb-0141-435f-b5d9-9517a9a59c47 tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] 10.222.0.47 "GET /compute/v2.1/servers/68e65823-58dc-4f2f-b814-bdd12dee87ad" status: 200 len: 1313 microversion: 2.1 time: 0.292263 Feb 19 05:02:05.030684 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 185/343] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:02:04 2021] GET /compute/v2.1/servers/68e65823-58dc-4f2f-b814-bdd12dee87ad => generated 1313 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 05:02:05.187961 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-3949f0cb-26b7-4f40-bb00-8b166b15ab8b tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:02:05.189233 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-3949f0cb-26b7-4f40-bb00-8b166b15ab8b tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] [instance: 74c5a115-b174-49fe-9b75-574e484a09e2] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:02:05.205128 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-3949f0cb-26b7-4f40-bb00-8b166b15ab8b tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:02:05.206690 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-3949f0cb-26b7-4f40-bb00-8b166b15ab8b tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:02:05.208412 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-3949f0cb-26b7-4f40-bb00-8b166b15ab8b tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:02:05.209324 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-3949f0cb-26b7-4f40-bb00-8b166b15ab8b tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:02:05.600715 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-3949f0cb-26b7-4f40-bb00-8b166b15ab8b tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24af0562e2aa43ca9d601be5e16fe9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ee9a43087d5497da3af9fbf68c4572d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:02:05.612730 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-3949f0cb-26b7-4f40-bb00-8b166b15ab8b tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] 10.222.0.47 "GET /compute/v2.1/servers/74c5a115-b174-49fe-9b75-574e484a09e2" status: 200 len: 1519 microversion: 2.1 time: 0.433049 Feb 19 05:02:05.620513 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 159/344] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:02:05 2021] GET /compute/v2.1/servers/74c5a115-b174-49fe-9b75-574e484a09e2 => generated 1519 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:02:05.686468 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-32b80921-011e-441d-b034-4e3064bcce06 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:02:05.687607 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-32b80921-011e-441d-b034-4e3064bcce06 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] [instance: 798b77ff-c3ca-4c65-a120-db12ad953621] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:02:05.698089 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-32b80921-011e-441d-b034-4e3064bcce06 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:02:05.699085 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-32b80921-011e-441d-b034-4e3064bcce06 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:02:05.700188 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-32b80921-011e-441d-b034-4e3064bcce06 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:02:05.700873 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-32b80921-011e-441d-b034-4e3064bcce06 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:02:05.775921 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [req-4ed547dd-a1e1-4744-9e88-a41f8388307c req-618152cc-a3ce-4458-9e18-d40c62eb7f5f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68e65823-58dc-4f2f-b814-bdd12dee87ad", "name": "network-vif-plugged", "status": "completed", "tag": "c64c00ef-0601-4ce8-827f-7c769d727b0d"}]} {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:02:05.780240 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 05:02:05.780240 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: warnings.warn(msg) Feb 19 05:02:05.794458 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [req-4ed547dd-a1e1-4744-9e88-a41f8388307c req-618152cc-a3ce-4458-9e18-d40c62eb7f5f service nova] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:02:05.795180 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [req-4ed547dd-a1e1-4744-9e88-a41f8388307c req-618152cc-a3ce-4458-9e18-d40c62eb7f5f service nova] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:02:05.816481 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.compute.server_external_events [req-4ed547dd-a1e1-4744-9e88-a41f8388307c req-618152cc-a3ce-4458-9e18-d40c62eb7f5f service nova] Creating event network-vif-plugged:c64c00ef-0601-4ce8-827f-7c769d727b0d for instance 68e65823-58dc-4f2f-b814-bdd12dee87ad on hv-cinder-77642 Feb 19 05:02:05.821940 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [req-4ed547dd-a1e1-4744-9e88-a41f8388307c req-618152cc-a3ce-4458-9e18-d40c62eb7f5f service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055838 Feb 19 05:02:05.822794 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 160/345] 10.222.0.47 () {64 vars in 1308 bytes} [Fri Feb 19 05:02:05 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 19 05:02:06.038167 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-32b80921-011e-441d-b034-4e3064bcce06 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:02:06.050146 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-32b80921-011e-441d-b034-4e3064bcce06 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:02:06.051565 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-39f5e5bb-b1ce-4f00-bf98-7fc4cab21435 tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:02:06.052404 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-32b80921-011e-441d-b034-4e3064bcce06 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:02:06.052693 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-39f5e5bb-b1ce-4f00-bf98-7fc4cab21435 tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] [instance: 68e65823-58dc-4f2f-b814-bdd12dee87ad] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:02:06.054156 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-32b80921-011e-441d-b034-4e3064bcce06 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] 10.222.0.47 "GET /compute/v2.1/servers/798b77ff-c3ca-4c65-a120-db12ad953621" status: 200 len: 1725 microversion: 2.20 time: 0.371910 Feb 19 05:02:06.054779 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 186/346] 10.222.0.47 () {60 vars in 1267 bytes} [Fri Feb 19 05:02:05 2021] GET /compute/v2.1/servers/798b77ff-c3ca-4c65-a120-db12ad953621 => generated 1725 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 05:02:06.062281 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-39f5e5bb-b1ce-4f00-bf98-7fc4cab21435 tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:02:06.062786 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-39f5e5bb-b1ce-4f00-bf98-7fc4cab21435 tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:02:06.063696 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-39f5e5bb-b1ce-4f00-bf98-7fc4cab21435 tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:02:06.064191 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-39f5e5bb-b1ce-4f00-bf98-7fc4cab21435 tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:02:06.436665 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-39f5e5bb-b1ce-4f00-bf98-7fc4cab21435 tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ac58c346fa4d569782f22a3394e22a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f6827c056bf4dc0b68a527187f4be9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:02:06.465643 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-39f5e5bb-b1ce-4f00-bf98-7fc4cab21435 tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] 10.222.0.47 "GET /compute/v2.1/servers/68e65823-58dc-4f2f-b814-bdd12dee87ad" status: 200 len: 1313 microversion: 2.1 time: 0.420508 Feb 19 05:02:06.466568 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 161/347] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:02:06 2021] GET /compute/v2.1/servers/68e65823-58dc-4f2f-b814-bdd12dee87ad => generated 1313 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:02:06.638232 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-a7c61bb4-351e-493f-8d34-96ab4e84bb67 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:02:06.642251 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-a7c61bb4-351e-493f-8d34-96ab4e84bb67 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] [instance: 74c5a115-b174-49fe-9b75-574e484a09e2] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:02:06.656682 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-a7c61bb4-351e-493f-8d34-96ab4e84bb67 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:02:06.657659 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-a7c61bb4-351e-493f-8d34-96ab4e84bb67 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:02:06.659007 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-a7c61bb4-351e-493f-8d34-96ab4e84bb67 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:02:06.660445 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-a7c61bb4-351e-493f-8d34-96ab4e84bb67 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:02:06.777407 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-57ab4ad1-34e5-410c-ab9e-775ee4f8b674 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2073734298", "imageRef": "53cdf9de-e495-4ca8-845f-6be2bf32cecb", "flavorRef": "452", "networks": [{"uuid": "f995194d-dcd5-48ad-baed-944751a68000"}]}} {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:02:06.916821 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.network.neutron [None req-57ab4ad1-34e5-410c-ab9e-775ee4f8b674 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] validate_networks() for [('f995194d-dcd5-48ad-baed-944751a68000', None, None, None)] {{(pid=98153) validate_networks /opt/stack/nova/nova/network/neutron.py:2345}} Feb 19 05:02:07.527703 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-a7c61bb4-351e-493f-8d34-96ab4e84bb67 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24af0562e2aa43ca9d601be5e16fe9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ee9a43087d5497da3af9fbf68c4572d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:02:07.542512 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-a7c61bb4-351e-493f-8d34-96ab4e84bb67 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] 10.222.0.47 "GET /compute/v2.1/servers/74c5a115-b174-49fe-9b75-574e484a09e2" status: 200 len: 1519 microversion: 2.1 time: 0.911489 Feb 19 05:02:07.554735 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 187/348] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:02:06 2021] GET /compute/v2.1/servers/74c5a115-b174-49fe-9b75-574e484a09e2 => generated 1519 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:02:07.554735 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-ed95009d-dbfc-4e5d-b74d-ca17cb3706b2 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:02:07.554735 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-ed95009d-dbfc-4e5d-b74d-ca17cb3706b2 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] [instance: 798b77ff-c3ca-4c65-a120-db12ad953621] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:02:07.568097 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-ed95009d-dbfc-4e5d-b74d-ca17cb3706b2 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:02:07.568971 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-ed95009d-dbfc-4e5d-b74d-ca17cb3706b2 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:02:07.572086 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-ed95009d-dbfc-4e5d-b74d-ca17cb3706b2 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:02:07.572949 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-ed95009d-dbfc-4e5d-b74d-ca17cb3706b2 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:02:08.098937 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-ed95009d-dbfc-4e5d-b74d-ca17cb3706b2 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:02:08.109735 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-ed95009d-dbfc-4e5d-b74d-ca17cb3706b2 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:02:08.111301 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-ed95009d-dbfc-4e5d-b74d-ca17cb3706b2 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:02:08.113122 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-ed95009d-dbfc-4e5d-b74d-ca17cb3706b2 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] 10.222.0.47 "GET /compute/v2.1/servers/798b77ff-c3ca-4c65-a120-db12ad953621" status: 200 len: 1725 microversion: 2.20 time: 0.567876 Feb 19 05:02:08.114123 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 188/349] 10.222.0.47 () {60 vars in 1267 bytes} [Fri Feb 19 05:02:07 2021] GET /compute/v2.1/servers/798b77ff-c3ca-4c65-a120-db12ad953621 => generated 1725 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 05:02:08.119378 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-936b0f3d-11e3-4520-87c7-b116e93f9993 tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:02:08.120056 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-936b0f3d-11e3-4520-87c7-b116e93f9993 tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] [instance: 68e65823-58dc-4f2f-b814-bdd12dee87ad] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:02:08.129241 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-936b0f3d-11e3-4520-87c7-b116e93f9993 tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:02:08.129993 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-936b0f3d-11e3-4520-87c7-b116e93f9993 tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:02:08.131046 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-936b0f3d-11e3-4520-87c7-b116e93f9993 tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:02:08.131828 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-936b0f3d-11e3-4520-87c7-b116e93f9993 tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:02:08.186061 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.virt.hardware [None req-57ab4ad1-34e5-410c-ab9e-775ee4f8b674 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Flavor limits 0:0:0 {{(pid=98153) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 19 05:02:08.187217 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.virt.hardware [None req-57ab4ad1-34e5-410c-ab9e-775ee4f8b674 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Image limits 0:0:0 {{(pid=98153) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Feb 19 05:02:08.189143 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.virt.hardware [None req-57ab4ad1-34e5-410c-ab9e-775ee4f8b674 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Flavor pref 0:0:0 {{(pid=98153) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 19 05:02:08.190785 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.virt.hardware [None req-57ab4ad1-34e5-410c-ab9e-775ee4f8b674 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Image pref 0:0:0 {{(pid=98153) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Feb 19 05:02:08.192448 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.virt.hardware [None req-57ab4ad1-34e5-410c-ab9e-775ee4f8b674 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98153) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Feb 19 05:02:08.216867 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-57ab4ad1-34e5-410c-ab9e-775ee4f8b674 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:02:08.218126 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-57ab4ad1-34e5-410c-ab9e-775ee4f8b674 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:02:08.219824 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-57ab4ad1-34e5-410c-ab9e-775ee4f8b674 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:02:08.220958 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-57ab4ad1-34e5-410c-ab9e-775ee4f8b674 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:02:08.267915 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.quota [None req-57ab4ad1-34e5-410c-ab9e-775ee4f8b674 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Getting quotas for project aa473e12960449bbb0713a709e0abe4e. Resources: {'instances', 'ram', 'cores'} {{(pid=98153) _get_quotas /opt/stack/nova/nova/quota.py:388}} Feb 19 05:02:08.277690 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.quota [None req-57ab4ad1-34e5-410c-ab9e-775ee4f8b674 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Getting quotas for user 628d846121a14be78329ccc727c8869d and project aa473e12960449bbb0713a709e0abe4e. Resources: {'instances', 'ram', 'cores'} {{(pid=98153) _get_quotas /opt/stack/nova/nova/quota.py:380}} Feb 19 05:02:08.306405 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-57ab4ad1-34e5-410c-ab9e-775ee4f8b674 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Going to run 1 instances... {{(pid=98153) _provision_instances /opt/stack/nova/nova/compute/api.py:1264}} Feb 19 05:02:08.312554 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-57ab4ad1-34e5-410c-ab9e-775ee4f8b674 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] [instance: d49e68e7-1b06-45d5-b811-440fe0435ed4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='53cdf9de-e495-4ca8-845f-6be2bf32cecb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98153) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1666}} Feb 19 05:02:08.387248 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-57ab4ad1-34e5-410c-ab9e-775ee4f8b674 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.619462 Feb 19 05:02:08.388217 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 162/350] 10.222.0.47 () {60 vars in 1137 bytes} [Fri Feb 19 05:02:06 2021] POST /compute/v2.1/servers => generated 380 bytes in 1621 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 19 05:02:08.399848 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-bdc18773-c279-48b8-a9c1-512aa10df801 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:02:08.400536 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-bdc18773-c279-48b8-a9c1-512aa10df801 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] [instance: d49e68e7-1b06-45d5-b811-440fe0435ed4] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:02:08.412364 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-936b0f3d-11e3-4520-87c7-b116e93f9993 tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ac58c346fa4d569782f22a3394e22a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f6827c056bf4dc0b68a527187f4be9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:02:08.428251 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-936b0f3d-11e3-4520-87c7-b116e93f9993 tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] 10.222.0.47 "GET /compute/v2.1/servers/68e65823-58dc-4f2f-b814-bdd12dee87ad" status: 200 len: 1313 microversion: 2.1 time: 0.312638 Feb 19 05:02:08.429281 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 189/351] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:02:08 2021] GET /compute/v2.1/servers/68e65823-58dc-4f2f-b814-bdd12dee87ad => generated 1313 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:02:08.495085 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-bdc18773-c279-48b8-a9c1-512aa10df801 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628d846121a14be78329ccc727c8869d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa473e12960449bbb0713a709e0abe4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:02:08.520131 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-bdc18773-c279-48b8-a9c1-512aa10df801 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] 10.222.0.47 "GET /compute/v2.1/servers/d49e68e7-1b06-45d5-b811-440fe0435ed4" status: 200 len: 1218 microversion: 2.1 time: 0.122943 Feb 19 05:02:08.521940 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 163/352] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:02:08 2021] GET /compute/v2.1/servers/d49e68e7-1b06-45d5-b811-440fe0435ed4 => generated 1218 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:02:08.574968 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-0116306e-a16e-49ec-979b-4e82aef6b8ee tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3ce4d0ed-0636-47ee-bb83-93131ea5ec82"}} {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:02:08.577550 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-fff08cec-f40f-4356-ae47-bc53e0f93b26 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:02:08.577967 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-0116306e-a16e-49ec-979b-4e82aef6b8ee tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] [instance: be65ea57-bc8d-4bce-80c3-33d8b6007ed1] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:02:08.579046 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-fff08cec-f40f-4356-ae47-bc53e0f93b26 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] [instance: 74c5a115-b174-49fe-9b75-574e484a09e2] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:02:08.596070 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-fff08cec-f40f-4356-ae47-bc53e0f93b26 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:02:08.597581 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-fff08cec-f40f-4356-ae47-bc53e0f93b26 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:02:08.599307 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-fff08cec-f40f-4356-ae47-bc53e0f93b26 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:02:08.600234 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-fff08cec-f40f-4356-ae47-bc53e0f93b26 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:02:08.603319 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-0116306e-a16e-49ec-979b-4e82aef6b8ee tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:02:08.604666 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-0116306e-a16e-49ec-979b-4e82aef6b8ee tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:02:08.606297 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-0116306e-a16e-49ec-979b-4e82aef6b8ee tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:02:08.607636 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-0116306e-a16e-49ec-979b-4e82aef6b8ee tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:02:09.022780 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-fff08cec-f40f-4356-ae47-bc53e0f93b26 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24af0562e2aa43ca9d601be5e16fe9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ee9a43087d5497da3af9fbf68c4572d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:02:09.041884 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-fff08cec-f40f-4356-ae47-bc53e0f93b26 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] 10.222.0.47 "GET /compute/v2.1/servers/74c5a115-b174-49fe-9b75-574e484a09e2" status: 200 len: 1499 microversion: 2.1 time: 0.472321 Feb 19 05:02:09.043116 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 164/353] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:02:08 2021] GET /compute/v2.1/servers/74c5a115-b174-49fe-9b75-574e484a09e2 => generated 1499 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:02:09.062960 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-010525fd-f7f0-4e0a-9c25-10a99a1ce412 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c1ee76e4-a0c8-4280-b166-b26f95fe9e60"}} {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:02:09.067220 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-010525fd-f7f0-4e0a-9c25-10a99a1ce412 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] [instance: 74c5a115-b174-49fe-9b75-574e484a09e2] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:02:09.073165 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-010525fd-f7f0-4e0a-9c25-10a99a1ce412 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:02:09.073667 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-010525fd-f7f0-4e0a-9c25-10a99a1ce412 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:02:09.074518 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-010525fd-f7f0-4e0a-9c25-10a99a1ce412 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:02:09.075008 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-010525fd-f7f0-4e0a-9c25-10a99a1ce412 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:02:09.212227 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.wsgi [None req-010525fd-f7f0-4e0a-9c25-10a99a1ce412 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] HTTP exception thrown: Cannot 'attach_volume' instance 74c5a115-b174-49fe-9b75-574e484a09e2 while it is in vm_state rescued Feb 19 05:02:09.213417 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-010525fd-f7f0-4e0a-9c25-10a99a1ce412 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Returning 409 to user: Cannot 'attach_volume' instance 74c5a115-b174-49fe-9b75-574e484a09e2 while it is in vm_state rescued {{(pid=98153) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 19 05:02:09.215356 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-010525fd-f7f0-4e0a-9c25-10a99a1ce412 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] 10.222.0.47 "POST /compute/v2.1/servers/74c5a115-b174-49fe-9b75-574e484a09e2/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.157326 Feb 19 05:02:09.216668 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 165/354] 10.222.0.47 () {60 vars in 1313 bytes} [Fri Feb 19 05:02:09 2021] POST /compute/v2.1/servers/74c5a115-b174-49fe-9b75-574e484a09e2/os-volume_attachments => generated 152 bytes in 160 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Feb 19 05:02:09.227071 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-eecd3e29-609a-4216-be06-872d9c4da631 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:02:09.228464 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-eecd3e29-609a-4216-be06-872d9c4da631 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] [instance: 798b77ff-c3ca-4c65-a120-db12ad953621] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:02:09.245551 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-eecd3e29-609a-4216-be06-872d9c4da631 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:02:09.246514 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-eecd3e29-609a-4216-be06-872d9c4da631 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:02:09.248235 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-eecd3e29-609a-4216-be06-872d9c4da631 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:02:09.249156 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-eecd3e29-609a-4216-be06-872d9c4da631 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:02:09.642774 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-eecd3e29-609a-4216-be06-872d9c4da631 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:02:09.667890 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-eecd3e29-609a-4216-be06-872d9c4da631 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:02:09.669277 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-eecd3e29-609a-4216-be06-872d9c4da631 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:02:09.673615 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-eecd3e29-609a-4216-be06-872d9c4da631 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] 10.222.0.47 "GET /compute/v2.1/servers/798b77ff-c3ca-4c65-a120-db12ad953621" status: 200 len: 1725 microversion: 2.20 time: 0.455303 Feb 19 05:02:09.674265 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 166/355] 10.222.0.47 () {60 vars in 1267 bytes} [Fri Feb 19 05:02:09 2021] GET /compute/v2.1/servers/798b77ff-c3ca-4c65-a120-db12ad953621 => generated 1725 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 05:02:09.685597 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-fcdd540e-c881-4898-8b98-10b832f0edf5 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:02:09.685597 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-fcdd540e-c881-4898-8b98-10b832f0edf5 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] [instance: 74c5a115-b174-49fe-9b75-574e484a09e2] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:02:09.690758 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-fcdd540e-c881-4898-8b98-10b832f0edf5 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:02:09.690758 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-fcdd540e-c881-4898-8b98-10b832f0edf5 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:02:09.692025 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-fcdd540e-c881-4898-8b98-10b832f0edf5 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:02:09.692549 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-fcdd540e-c881-4898-8b98-10b832f0edf5 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:02:09.740934 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-0116306e-a16e-49ec-979b-4e82aef6b8ee tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] 10.222.0.47 "POST /compute/v2.1/servers/be65ea57-bc8d-4bce-80c3-33d8b6007ed1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.175062 Feb 19 05:02:09.742761 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 190/356] 10.222.0.47 () {60 vars in 1313 bytes} [Fri Feb 19 05:02:08 2021] POST /compute/v2.1/servers/be65ea57-bc8d-4bce-80c3-33d8b6007ed1/os-volume_attachments => generated 194 bytes in 1179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 05:02:09.791932 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-7d62a47c-3cc5-4353-a163-724e726f5829 tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:02:09.798120 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-7d62a47c-3cc5-4353-a163-724e726f5829 tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] [instance: 68e65823-58dc-4f2f-b814-bdd12dee87ad] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:02:09.824140 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-7d62a47c-3cc5-4353-a163-724e726f5829 tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:02:09.825643 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-7d62a47c-3cc5-4353-a163-724e726f5829 tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:02:09.828771 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-7d62a47c-3cc5-4353-a163-724e726f5829 tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:02:09.830337 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-7d62a47c-3cc5-4353-a163-724e726f5829 tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:02:10.006959 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-fcdd540e-c881-4898-8b98-10b832f0edf5 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] 10.222.0.47 "POST /compute/v2.1/servers/74c5a115-b174-49fe-9b75-574e484a09e2/action" status: 202 len: 0 microversion: 2.1 time: 0.330300 Feb 19 05:02:10.007822 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 167/357] 10.222.0.47 () {60 vars in 1268 bytes} [Fri Feb 19 05:02:09 2021] POST /compute/v2.1/servers/74c5a115-b174-49fe-9b75-574e484a09e2/action => generated 0 bytes in 332 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 19 05:02:10.019800 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-2c36ec2b-61b1-43ea-bf57-e6d02c1f16d9 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:02:10.020729 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-2c36ec2b-61b1-43ea-bf57-e6d02c1f16d9 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] [instance: d49e68e7-1b06-45d5-b811-440fe0435ed4] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:02:10.034096 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-2c36ec2b-61b1-43ea-bf57-e6d02c1f16d9 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:02:10.034729 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-2c36ec2b-61b1-43ea-bf57-e6d02c1f16d9 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:02:10.035934 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-2c36ec2b-61b1-43ea-bf57-e6d02c1f16d9 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:02:10.036502 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-2c36ec2b-61b1-43ea-bf57-e6d02c1f16d9 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:02:10.197796 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-2c36ec2b-61b1-43ea-bf57-e6d02c1f16d9 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628d846121a14be78329ccc727c8869d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa473e12960449bbb0713a709e0abe4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:02:10.247196 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-2c36ec2b-61b1-43ea-bf57-e6d02c1f16d9 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] 10.222.0.47 "GET /compute/v2.1/servers/d49e68e7-1b06-45d5-b811-440fe0435ed4" status: 200 len: 1270 microversion: 2.1 time: 0.233217 Feb 19 05:02:10.262360 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 168/358] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:02:10 2021] GET /compute/v2.1/servers/d49e68e7-1b06-45d5-b811-440fe0435ed4 => generated 1270 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:02:10.286290 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-5ce26bec-8bb2-412d-9f18-cdfd0c946c65 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:02:10.287752 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-5ce26bec-8bb2-412d-9f18-cdfd0c946c65 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] [instance: 74c5a115-b174-49fe-9b75-574e484a09e2] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:02:10.305648 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-5ce26bec-8bb2-412d-9f18-cdfd0c946c65 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:02:10.306532 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-5ce26bec-8bb2-412d-9f18-cdfd0c946c65 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:02:10.310344 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-5ce26bec-8bb2-412d-9f18-cdfd0c946c65 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:02:10.310995 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-5ce26bec-8bb2-412d-9f18-cdfd0c946c65 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:02:10.423131 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-7d62a47c-3cc5-4353-a163-724e726f5829 tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ac58c346fa4d569782f22a3394e22a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f6827c056bf4dc0b68a527187f4be9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:02:10.438318 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-7d62a47c-3cc5-4353-a163-724e726f5829 tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] 10.222.0.47 "GET /compute/v2.1/servers/68e65823-58dc-4f2f-b814-bdd12dee87ad" status: 200 len: 1497 microversion: 2.1 time: 0.693329 Feb 19 05:02:10.462409 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 191/359] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:02:09 2021] GET /compute/v2.1/servers/68e65823-58dc-4f2f-b814-bdd12dee87ad => generated 1497 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:02:10.666772 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-5ce26bec-8bb2-412d-9f18-cdfd0c946c65 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24af0562e2aa43ca9d601be5e16fe9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ee9a43087d5497da3af9fbf68c4572d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:02:10.678220 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-5ce26bec-8bb2-412d-9f18-cdfd0c946c65 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] 10.222.0.47 "GET /compute/v2.1/servers/74c5a115-b174-49fe-9b75-574e484a09e2" status: 200 len: 1507 microversion: 2.1 time: 0.403100 Feb 19 05:02:10.679240 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 169/360] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:02:10 2021] GET /compute/v2.1/servers/74c5a115-b174-49fe-9b75-574e484a09e2 => generated 1507 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:02:10.713667 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-a4db8a9b-a754-4793-bd91-574278b12b6c tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:02:10.718204 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-a4db8a9b-a754-4793-bd91-574278b12b6c tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] [instance: 798b77ff-c3ca-4c65-a120-db12ad953621] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:02:10.729009 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-a4db8a9b-a754-4793-bd91-574278b12b6c tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:02:10.729533 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-a4db8a9b-a754-4793-bd91-574278b12b6c tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:02:10.730404 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-a4db8a9b-a754-4793-bd91-574278b12b6c tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:02:10.730882 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-a4db8a9b-a754-4793-bd91-574278b12b6c tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:02:11.283469 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-f8abac33-a1ab-4409-9df3-4db2e26e2c69 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:02:11.284768 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-f8abac33-a1ab-4409-9df3-4db2e26e2c69 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] [instance: d49e68e7-1b06-45d5-b811-440fe0435ed4] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:02:11.295222 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-f8abac33-a1ab-4409-9df3-4db2e26e2c69 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:02:11.296041 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-f8abac33-a1ab-4409-9df3-4db2e26e2c69 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:02:11.297213 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-f8abac33-a1ab-4409-9df3-4db2e26e2c69 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:02:11.297971 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-f8abac33-a1ab-4409-9df3-4db2e26e2c69 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:02:11.543911 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-f8abac33-a1ab-4409-9df3-4db2e26e2c69 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628d846121a14be78329ccc727c8869d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa473e12960449bbb0713a709e0abe4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:02:11.561169 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-f8abac33-a1ab-4409-9df3-4db2e26e2c69 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] 10.222.0.47 "GET /compute/v2.1/servers/d49e68e7-1b06-45d5-b811-440fe0435ed4" status: 200 len: 1276 microversion: 2.1 time: 0.282417 Feb 19 05:02:11.566909 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 170/361] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:02:11 2021] GET /compute/v2.1/servers/d49e68e7-1b06-45d5-b811-440fe0435ed4 => generated 1276 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 05:02:11.688342 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-a4db8a9b-a754-4793-bd91-574278b12b6c tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:02:11.698826 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-6f0460a9-edaa-4657-800d-1cfd5857abec tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:02:11.700394 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-6f0460a9-edaa-4657-800d-1cfd5857abec tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] [instance: 74c5a115-b174-49fe-9b75-574e484a09e2] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:02:11.715174 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-6f0460a9-edaa-4657-800d-1cfd5857abec tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:02:11.721670 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-6f0460a9-edaa-4657-800d-1cfd5857abec tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:02:11.723470 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-6f0460a9-edaa-4657-800d-1cfd5857abec tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:02:11.724089 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-a4db8a9b-a754-4793-bd91-574278b12b6c tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:02:11.726146 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-a4db8a9b-a754-4793-bd91-574278b12b6c tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:02:11.726817 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-6f0460a9-edaa-4657-800d-1cfd5857abec tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:02:11.742583 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-a4db8a9b-a754-4793-bd91-574278b12b6c tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] 10.222.0.47 "GET /compute/v2.1/servers/798b77ff-c3ca-4c65-a120-db12ad953621" status: 200 len: 1725 microversion: 2.20 time: 1.033093 Feb 19 05:02:11.759426 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 192/362] 10.222.0.47 () {60 vars in 1267 bytes} [Fri Feb 19 05:02:10 2021] GET /compute/v2.1/servers/798b77ff-c3ca-4c65-a120-db12ad953621 => generated 1725 bytes in 1051 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 05:02:12.298963 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-6f0460a9-edaa-4657-800d-1cfd5857abec tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24af0562e2aa43ca9d601be5e16fe9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ee9a43087d5497da3af9fbf68c4572d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:02:12.321022 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-6f0460a9-edaa-4657-800d-1cfd5857abec tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] 10.222.0.47 "GET /compute/v2.1/servers/74c5a115-b174-49fe-9b75-574e484a09e2" status: 200 len: 1507 microversion: 2.1 time: 0.626158 Feb 19 05:02:12.323772 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 171/363] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:02:11 2021] GET /compute/v2.1/servers/74c5a115-b174-49fe-9b75-574e484a09e2 => generated 1507 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:02:12.586107 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-21c61e16-3e8a-4a52-98f4-fc197a4be10a tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:02:12.587756 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-21c61e16-3e8a-4a52-98f4-fc197a4be10a tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] [instance: d49e68e7-1b06-45d5-b811-440fe0435ed4] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:02:12.597114 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-21c61e16-3e8a-4a52-98f4-fc197a4be10a tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:02:12.597629 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-21c61e16-3e8a-4a52-98f4-fc197a4be10a tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:02:12.598774 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-21c61e16-3e8a-4a52-98f4-fc197a4be10a tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:02:12.599276 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-21c61e16-3e8a-4a52-98f4-fc197a4be10a tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:02:12.768938 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-8f0ca5a6-1374-4f02-9dcc-a4dcb05eb928 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:02:12.769765 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-8f0ca5a6-1374-4f02-9dcc-a4dcb05eb928 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] [instance: 798b77ff-c3ca-4c65-a120-db12ad953621] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:02:12.778587 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-8f0ca5a6-1374-4f02-9dcc-a4dcb05eb928 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:02:12.779137 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-8f0ca5a6-1374-4f02-9dcc-a4dcb05eb928 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:02:12.780014 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-8f0ca5a6-1374-4f02-9dcc-a4dcb05eb928 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:02:12.780503 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-8f0ca5a6-1374-4f02-9dcc-a4dcb05eb928 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:02:12.832457 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-21c61e16-3e8a-4a52-98f4-fc197a4be10a tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628d846121a14be78329ccc727c8869d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa473e12960449bbb0713a709e0abe4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:02:12.855891 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-21c61e16-3e8a-4a52-98f4-fc197a4be10a tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] 10.222.0.47 "GET /compute/v2.1/servers/d49e68e7-1b06-45d5-b811-440fe0435ed4" status: 200 len: 1276 microversion: 2.1 time: 0.273208 Feb 19 05:02:12.858162 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 193/364] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:02:12 2021] GET /compute/v2.1/servers/d49e68e7-1b06-45d5-b811-440fe0435ed4 => generated 1276 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:02:13.007807 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-70a31782-1784-4060-b823-a5ca1ec79cee tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:02:13.008861 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-70a31782-1784-4060-b823-a5ca1ec79cee tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] [instance: 68e65823-58dc-4f2f-b814-bdd12dee87ad] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:02:13.018743 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-70a31782-1784-4060-b823-a5ca1ec79cee tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:02:13.019798 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-70a31782-1784-4060-b823-a5ca1ec79cee tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:02:13.021286 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-70a31782-1784-4060-b823-a5ca1ec79cee tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:02:13.021984 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-70a31782-1784-4060-b823-a5ca1ec79cee tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:02:13.112897 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-70a31782-1784-4060-b823-a5ca1ec79cee tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] [instance: 68e65823-58dc-4f2f-b814-bdd12dee87ad] Going to try to terminate instance {{(pid=98154) delete /opt/stack/nova/nova/compute/api.py:2540}} Feb 19 05:02:13.305828 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-70a31782-1784-4060-b823-a5ca1ec79cee tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] 10.222.0.47 "DELETE /compute/v2.1/servers/68e65823-58dc-4f2f-b814-bdd12dee87ad" status: 204 len: 0 microversion: 2.1 time: 0.301299 Feb 19 05:02:13.307016 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 194/365] 10.222.0.47 () {58 vars in 1229 bytes} [Fri Feb 19 05:02:13 2021] DELETE /compute/v2.1/servers/68e65823-58dc-4f2f-b814-bdd12dee87ad => generated 0 bytes in 305 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 19 05:02:13.330768 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-6db85631-81dd-4384-a0dc-13082dcf5770 tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:02:13.332534 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-6db85631-81dd-4384-a0dc-13082dcf5770 tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] [instance: 68e65823-58dc-4f2f-b814-bdd12dee87ad] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:02:13.351987 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-6db85631-81dd-4384-a0dc-13082dcf5770 tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:02:13.353432 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-6db85631-81dd-4384-a0dc-13082dcf5770 tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:02:13.356409 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-6db85631-81dd-4384-a0dc-13082dcf5770 tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:02:13.358280 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-6db85631-81dd-4384-a0dc-13082dcf5770 tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:02:13.480239 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-8f0ca5a6-1374-4f02-9dcc-a4dcb05eb928 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:02:13.500865 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-8f0ca5a6-1374-4f02-9dcc-a4dcb05eb928 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:02:13.505504 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-8f0ca5a6-1374-4f02-9dcc-a4dcb05eb928 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:02:13.508072 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-8f0ca5a6-1374-4f02-9dcc-a4dcb05eb928 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] 10.222.0.47 "GET /compute/v2.1/servers/798b77ff-c3ca-4c65-a120-db12ad953621" status: 200 len: 1725 microversion: 2.20 time: 0.744665 Feb 19 05:02:13.509537 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 172/366] 10.222.0.47 () {60 vars in 1267 bytes} [Fri Feb 19 05:02:12 2021] GET /compute/v2.1/servers/798b77ff-c3ca-4c65-a120-db12ad953621 => generated 1725 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 05:02:13.520697 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-8c4ed8e8-e3cf-4112-a6c0-b2177701f95e tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:02:13.522697 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-8c4ed8e8-e3cf-4112-a6c0-b2177701f95e tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] [instance: 74c5a115-b174-49fe-9b75-574e484a09e2] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:02:13.547027 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-8c4ed8e8-e3cf-4112-a6c0-b2177701f95e tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:02:13.548303 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-8c4ed8e8-e3cf-4112-a6c0-b2177701f95e tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:02:13.551051 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-8c4ed8e8-e3cf-4112-a6c0-b2177701f95e tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:02:13.552348 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-8c4ed8e8-e3cf-4112-a6c0-b2177701f95e tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:02:14.191261 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-6db85631-81dd-4384-a0dc-13082dcf5770 tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ac58c346fa4d569782f22a3394e22a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f6827c056bf4dc0b68a527187f4be9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:02:14.217555 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-6db85631-81dd-4384-a0dc-13082dcf5770 tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] 10.222.0.47 "GET /compute/v2.1/servers/68e65823-58dc-4f2f-b814-bdd12dee87ad" status: 200 len: 1503 microversion: 2.1 time: 0.898343 Feb 19 05:02:14.219442 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 195/367] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:02:13 2021] GET /compute/v2.1/servers/68e65823-58dc-4f2f-b814-bdd12dee87ad => generated 1503 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:02:14.235052 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-caff3e33-e386-4fac-beda-9587d35a9d73 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:02:14.237203 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-caff3e33-e386-4fac-beda-9587d35a9d73 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] [instance: d49e68e7-1b06-45d5-b811-440fe0435ed4] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:02:14.265656 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-caff3e33-e386-4fac-beda-9587d35a9d73 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:02:14.287245 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-caff3e33-e386-4fac-beda-9587d35a9d73 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:02:14.289072 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-caff3e33-e386-4fac-beda-9587d35a9d73 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:02:14.290585 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-caff3e33-e386-4fac-beda-9587d35a9d73 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:02:14.458198 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-8c4ed8e8-e3cf-4112-a6c0-b2177701f95e tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24af0562e2aa43ca9d601be5e16fe9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ee9a43087d5497da3af9fbf68c4572d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:02:14.470565 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-8c4ed8e8-e3cf-4112-a6c0-b2177701f95e tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] 10.222.0.47 "GET /compute/v2.1/servers/74c5a115-b174-49fe-9b75-574e484a09e2" status: 200 len: 1507 microversion: 2.1 time: 0.958845 Feb 19 05:02:14.471811 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 173/368] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:02:13 2021] GET /compute/v2.1/servers/74c5a115-b174-49fe-9b75-574e484a09e2 => generated 1507 bytes in 961 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:02:14.536115 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-ea6cc161-b820-43fe-951a-33e051c247b6 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:02:14.544421 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-ea6cc161-b820-43fe-951a-33e051c247b6 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] [instance: 798b77ff-c3ca-4c65-a120-db12ad953621] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:02:14.563819 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-ea6cc161-b820-43fe-951a-33e051c247b6 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:02:14.565668 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-ea6cc161-b820-43fe-951a-33e051c247b6 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:02:14.567860 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-ea6cc161-b820-43fe-951a-33e051c247b6 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:02:14.569197 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-ea6cc161-b820-43fe-951a-33e051c247b6 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:02:15.495389 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-ea6cc161-b820-43fe-951a-33e051c247b6 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:02:15.500809 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-caff3e33-e386-4fac-beda-9587d35a9d73 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628d846121a14be78329ccc727c8869d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa473e12960449bbb0713a709e0abe4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:02:15.507800 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-ea6cc161-b820-43fe-951a-33e051c247b6 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:02:15.510372 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-ea6cc161-b820-43fe-951a-33e051c247b6 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:02:15.511916 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-ea6cc161-b820-43fe-951a-33e051c247b6 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] 10.222.0.47 "GET /compute/v2.1/servers/798b77ff-c3ca-4c65-a120-db12ad953621" status: 200 len: 1725 microversion: 2.20 time: 0.985050 Feb 19 05:02:15.512735 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 174/369] 10.222.0.47 () {60 vars in 1267 bytes} [Fri Feb 19 05:02:14 2021] GET /compute/v2.1/servers/798b77ff-c3ca-4c65-a120-db12ad953621 => generated 1725 bytes in 987 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 19 05:02:15.523510 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-caff3e33-e386-4fac-beda-9587d35a9d73 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] 10.222.0.47 "GET /compute/v2.1/servers/d49e68e7-1b06-45d5-b811-440fe0435ed4" status: 200 len: 1318 microversion: 2.1 time: 1.291225 Feb 19 05:02:15.523510 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 196/370] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:02:14 2021] GET /compute/v2.1/servers/d49e68e7-1b06-45d5-b811-440fe0435ed4 => generated 1318 bytes in 1296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:02:15.529829 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-7a7743a4-85dd-4f4c-b71f-3385f7ad8a35 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:02:15.530800 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-7a7743a4-85dd-4f4c-b71f-3385f7ad8a35 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] [instance: 74c5a115-b174-49fe-9b75-574e484a09e2] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:02:15.540902 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-7a7743a4-85dd-4f4c-b71f-3385f7ad8a35 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:02:15.541734 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-7a7743a4-85dd-4f4c-b71f-3385f7ad8a35 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:02:15.542860 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-7a7743a4-85dd-4f4c-b71f-3385f7ad8a35 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:02:15.543563 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-7a7743a4-85dd-4f4c-b71f-3385f7ad8a35 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:02:15.544443 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-b9869ccb-2b8c-462d-9e98-abb622bac50a tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:02:15.545243 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-b9869ccb-2b8c-462d-9e98-abb622bac50a tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] [instance: 68e65823-58dc-4f2f-b814-bdd12dee87ad] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:02:15.561402 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-b9869ccb-2b8c-462d-9e98-abb622bac50a tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:02:15.564287 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-b9869ccb-2b8c-462d-9e98-abb622bac50a tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:02:15.567792 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-b9869ccb-2b8c-462d-9e98-abb622bac50a tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:02:15.568502 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-b9869ccb-2b8c-462d-9e98-abb622bac50a tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:02:16.371943 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-7a7743a4-85dd-4f4c-b71f-3385f7ad8a35 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24af0562e2aa43ca9d601be5e16fe9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ee9a43087d5497da3af9fbf68c4572d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:02:16.377771 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-b9869ccb-2b8c-462d-9e98-abb622bac50a tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ac58c346fa4d569782f22a3394e22a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f6827c056bf4dc0b68a527187f4be9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:02:16.393595 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-7a7743a4-85dd-4f4c-b71f-3385f7ad8a35 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] 10.222.0.47 "GET /compute/v2.1/servers/74c5a115-b174-49fe-9b75-574e484a09e2" status: 200 len: 1513 microversion: 2.1 time: 0.867496 Feb 19 05:02:16.396986 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 175/371] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:02:15 2021] GET /compute/v2.1/servers/74c5a115-b174-49fe-9b75-574e484a09e2 => generated 1513 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:02:16.405565 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-b9869ccb-2b8c-462d-9e98-abb622bac50a tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] 10.222.0.47 "GET /compute/v2.1/servers/68e65823-58dc-4f2f-b814-bdd12dee87ad" status: 200 len: 1503 microversion: 2.1 time: 0.873847 Feb 19 05:02:16.406911 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 197/372] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:02:15 2021] GET /compute/v2.1/servers/68e65823-58dc-4f2f-b814-bdd12dee87ad => generated 1503 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:02:16.551081 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-8b457775-c3e4-40b0-b397-be0e231e10a6 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:02:16.554840 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-c3f3cca7-4f44-47b0-902f-2bbef691a33c tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:02:16.556441 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-c3f3cca7-4f44-47b0-902f-2bbef691a33c tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] [instance: 798b77ff-c3ca-4c65-a120-db12ad953621] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:02:16.562444 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-8b457775-c3e4-40b0-b397-be0e231e10a6 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] [instance: d49e68e7-1b06-45d5-b811-440fe0435ed4] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:02:16.606142 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-c3f3cca7-4f44-47b0-902f-2bbef691a33c tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:02:16.617892 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-8b457775-c3e4-40b0-b397-be0e231e10a6 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:02:16.618669 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-8b457775-c3e4-40b0-b397-be0e231e10a6 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:02:16.621455 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-c3f3cca7-4f44-47b0-902f-2bbef691a33c tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:02:16.623055 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-c3f3cca7-4f44-47b0-902f-2bbef691a33c tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:02:16.624005 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-c3f3cca7-4f44-47b0-902f-2bbef691a33c tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:02:16.631670 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-8b457775-c3e4-40b0-b397-be0e231e10a6 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:02:16.633073 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-8b457775-c3e4-40b0-b397-be0e231e10a6 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:02:17.631729 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-8b457775-c3e4-40b0-b397-be0e231e10a6 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628d846121a14be78329ccc727c8869d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa473e12960449bbb0713a709e0abe4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:02:17.673125 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-8b457775-c3e4-40b0-b397-be0e231e10a6 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] 10.222.0.47 "GET /compute/v2.1/servers/d49e68e7-1b06-45d5-b811-440fe0435ed4" status: 200 len: 1318 microversion: 2.1 time: 1.141742 Feb 19 05:02:17.674871 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 176/373] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:02:16 2021] GET /compute/v2.1/servers/d49e68e7-1b06-45d5-b811-440fe0435ed4 => generated 1318 bytes in 1145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:02:17.697845 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [req-3b510d31-05a2-457d-9c0e-d0564876eacf req-f759da75-c500-48c5-8b67-a2b3f2bd8fa1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d49e68e7-1b06-45d5-b811-440fe0435ed4", "tag": "8b909732-be36-45f2-ab6d-689515c337d4"}]} {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:02:17.707907 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 05:02:17.707907 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: warnings.warn(msg) Feb 19 05:02:17.711384 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-c3f3cca7-4f44-47b0-902f-2bbef691a33c tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:02:17.726498 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-c3f3cca7-4f44-47b0-902f-2bbef691a33c tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:02:17.728328 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-c3f3cca7-4f44-47b0-902f-2bbef691a33c tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:02:17.729636 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-c3f3cca7-4f44-47b0-902f-2bbef691a33c tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] 10.222.0.47 "GET /compute/v2.1/servers/798b77ff-c3ca-4c65-a120-db12ad953621" status: 200 len: 1725 microversion: 2.20 time: 1.193704 Feb 19 05:02:17.730273 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 198/374] 10.222.0.47 () {60 vars in 1267 bytes} [Fri Feb 19 05:02:16 2021] GET /compute/v2.1/servers/798b77ff-c3ca-4c65-a120-db12ad953621 => generated 1725 bytes in 1195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 05:02:17.731449 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [req-3b510d31-05a2-457d-9c0e-d0564876eacf req-f759da75-c500-48c5-8b67-a2b3f2bd8fa1 service nova] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:02:17.732700 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [req-3b510d31-05a2-457d-9c0e-d0564876eacf req-f759da75-c500-48c5-8b67-a2b3f2bd8fa1 service nova] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:02:17.737069 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-a40a1dee-efef-49fd-ab74-e260be4ea5a5 tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:02:17.737562 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-a40a1dee-efef-49fd-ab74-e260be4ea5a5 tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] [instance: 68e65823-58dc-4f2f-b814-bdd12dee87ad] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:02:17.763954 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-a40a1dee-efef-49fd-ab74-e260be4ea5a5 tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:02:17.764433 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-a40a1dee-efef-49fd-ab74-e260be4ea5a5 tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:02:17.765491 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-a40a1dee-efef-49fd-ab74-e260be4ea5a5 tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:02:17.770489 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-a40a1dee-efef-49fd-ab74-e260be4ea5a5 tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:02:17.784111 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.compute.server_external_events [req-3b510d31-05a2-457d-9c0e-d0564876eacf req-f759da75-c500-48c5-8b67-a2b3f2bd8fa1 service nova] Creating event network-changed:8b909732-be36-45f2-ab6d-689515c337d4 for instance d49e68e7-1b06-45d5-b811-440fe0435ed4 on hv-cinder-77642 Feb 19 05:02:17.796556 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [req-3b510d31-05a2-457d-9c0e-d0564876eacf req-f759da75-c500-48c5-8b67-a2b3f2bd8fa1 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115524 Feb 19 05:02:17.797989 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 177/375] 10.222.0.47 () {64 vars in 1308 bytes} [Fri Feb 19 05:02:17 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 05:02:17.815924 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [req-0f78693d-e9c3-42b5-81a9-9ef4d9ce55d4 req-d2663b97-d57e-4d7a-b27f-3b14dff121a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68e65823-58dc-4f2f-b814-bdd12dee87ad", "name": "network-vif-unplugged", "status": "completed", "tag": "c64c00ef-0601-4ce8-827f-7c769d727b0d"}]} {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:02:17.820289 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 05:02:17.820289 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: warnings.warn(msg) Feb 19 05:02:17.848453 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [req-0f78693d-e9c3-42b5-81a9-9ef4d9ce55d4 req-d2663b97-d57e-4d7a-b27f-3b14dff121a8 service nova] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:02:17.850044 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [req-0f78693d-e9c3-42b5-81a9-9ef4d9ce55d4 req-d2663b97-d57e-4d7a-b27f-3b14dff121a8 service nova] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:02:17.904041 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.compute.server_external_events [req-0f78693d-e9c3-42b5-81a9-9ef4d9ce55d4 req-d2663b97-d57e-4d7a-b27f-3b14dff121a8 service nova] Creating event network-vif-unplugged:c64c00ef-0601-4ce8-827f-7c769d727b0d for instance 68e65823-58dc-4f2f-b814-bdd12dee87ad on hv-cinder-77642 Feb 19 05:02:17.918648 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [req-0f78693d-e9c3-42b5-81a9-9ef4d9ce55d4 req-d2663b97-d57e-4d7a-b27f-3b14dff121a8 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.117148 Feb 19 05:02:17.957538 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 178/376] 10.222.0.47 () {64 vars in 1308 bytes} [Fri Feb 19 05:02:17 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 05:02:18.403116 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-82f4a477-07ce-4a06-9140-86101e960ec7 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:02:18.404277 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-82f4a477-07ce-4a06-9140-86101e960ec7 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] [instance: 74c5a115-b174-49fe-9b75-574e484a09e2] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:02:18.417851 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-82f4a477-07ce-4a06-9140-86101e960ec7 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:02:18.418932 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-82f4a477-07ce-4a06-9140-86101e960ec7 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:02:18.420106 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-a40a1dee-efef-49fd-ab74-e260be4ea5a5 tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ac58c346fa4d569782f22a3394e22a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f6827c056bf4dc0b68a527187f4be9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:02:18.420525 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-82f4a477-07ce-4a06-9140-86101e960ec7 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:02:18.421374 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-82f4a477-07ce-4a06-9140-86101e960ec7 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:02:18.437896 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-a40a1dee-efef-49fd-ab74-e260be4ea5a5 tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] 10.222.0.47 "GET /compute/v2.1/servers/68e65823-58dc-4f2f-b814-bdd12dee87ad" status: 200 len: 1503 microversion: 2.1 time: 0.704591 Feb 19 05:02:18.439242 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 199/377] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:02:17 2021] GET /compute/v2.1/servers/68e65823-58dc-4f2f-b814-bdd12dee87ad => generated 1503 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:02:18.693657 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-669342b9-cb9b-407f-a728-1891bb9a3b46 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:02:18.694837 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-669342b9-cb9b-407f-a728-1891bb9a3b46 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] [instance: d49e68e7-1b06-45d5-b811-440fe0435ed4] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:02:18.709227 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-669342b9-cb9b-407f-a728-1891bb9a3b46 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:02:18.710503 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-669342b9-cb9b-407f-a728-1891bb9a3b46 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:02:18.712423 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-669342b9-cb9b-407f-a728-1891bb9a3b46 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:02:18.713298 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-669342b9-cb9b-407f-a728-1891bb9a3b46 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:02:19.136005 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-82f4a477-07ce-4a06-9140-86101e960ec7 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24af0562e2aa43ca9d601be5e16fe9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ee9a43087d5497da3af9fbf68c4572d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:02:19.146991 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-82f4a477-07ce-4a06-9140-86101e960ec7 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] 10.222.0.47 "GET /compute/v2.1/servers/74c5a115-b174-49fe-9b75-574e484a09e2" status: 200 len: 1513 microversion: 2.1 time: 0.749206 Feb 19 05:02:19.147863 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 179/378] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:02:18 2021] GET /compute/v2.1/servers/74c5a115-b174-49fe-9b75-574e484a09e2 => generated 1513 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:02:19.168932 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-860ebbb8-f77c-4bb2-b421-2848d10bf538 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:02:19.169873 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-860ebbb8-f77c-4bb2-b421-2848d10bf538 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] [instance: 798b77ff-c3ca-4c65-a120-db12ad953621] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:02:19.185332 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-860ebbb8-f77c-4bb2-b421-2848d10bf538 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:02:19.185856 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-860ebbb8-f77c-4bb2-b421-2848d10bf538 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:02:19.186737 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-860ebbb8-f77c-4bb2-b421-2848d10bf538 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:02:19.187240 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-860ebbb8-f77c-4bb2-b421-2848d10bf538 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:02:19.278218 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-669342b9-cb9b-407f-a728-1891bb9a3b46 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628d846121a14be78329ccc727c8869d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa473e12960449bbb0713a709e0abe4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:02:19.301838 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-669342b9-cb9b-407f-a728-1891bb9a3b46 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] 10.222.0.47 "GET /compute/v2.1/servers/d49e68e7-1b06-45d5-b811-440fe0435ed4" status: 200 len: 1318 microversion: 2.1 time: 0.612590 Feb 19 05:02:19.303155 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 200/379] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:02:18 2021] GET /compute/v2.1/servers/d49e68e7-1b06-45d5-b811-440fe0435ed4 => generated 1318 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:02:19.315523 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-7e4b36a2-cb15-4e57-83ae-e6106b615171 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dfeaee6c-a0ad-4a23-ad13-73f31fa31f1c"}} {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:02:19.318728 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-7e4b36a2-cb15-4e57-83ae-e6106b615171 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] [instance: 74c5a115-b174-49fe-9b75-574e484a09e2] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:02:19.341208 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-7e4b36a2-cb15-4e57-83ae-e6106b615171 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:02:19.342792 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-7e4b36a2-cb15-4e57-83ae-e6106b615171 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:02:19.344745 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-7e4b36a2-cb15-4e57-83ae-e6106b615171 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:02:19.346527 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-7e4b36a2-cb15-4e57-83ae-e6106b615171 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:02:19.452447 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-860ebbb8-f77c-4bb2-b421-2848d10bf538 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:02:19.464681 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-860ebbb8-f77c-4bb2-b421-2848d10bf538 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:02:19.466367 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-860ebbb8-f77c-4bb2-b421-2848d10bf538 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:02:19.467791 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-860ebbb8-f77c-4bb2-b421-2848d10bf538 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] 10.222.0.47 "GET /compute/v2.1/servers/798b77ff-c3ca-4c65-a120-db12ad953621" status: 200 len: 1725 microversion: 2.20 time: 0.306609 Feb 19 05:02:19.468425 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 180/380] 10.222.0.47 () {60 vars in 1267 bytes} [Fri Feb 19 05:02:19 2021] GET /compute/v2.1/servers/798b77ff-c3ca-4c65-a120-db12ad953621 => generated 1725 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 05:02:19.476746 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-3606307a-fecc-489e-80ea-506b0bf6788a tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:02:19.477981 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-3606307a-fecc-489e-80ea-506b0bf6788a tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] [instance: 68e65823-58dc-4f2f-b814-bdd12dee87ad] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:02:19.488562 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-3606307a-fecc-489e-80ea-506b0bf6788a tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:02:19.489403 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-3606307a-fecc-489e-80ea-506b0bf6788a tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:02:19.490551 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-3606307a-fecc-489e-80ea-506b0bf6788a tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:02:19.491167 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-3606307a-fecc-489e-80ea-506b0bf6788a tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:02:19.647887 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-3606307a-fecc-489e-80ea-506b0bf6788a tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ac58c346fa4d569782f22a3394e22a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f6827c056bf4dc0b68a527187f4be9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:02:19.661623 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-3606307a-fecc-489e-80ea-506b0bf6788a tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] 10.222.0.47 "GET /compute/v2.1/servers/68e65823-58dc-4f2f-b814-bdd12dee87ad" status: 200 len: 1461 microversion: 2.1 time: 0.190367 Feb 19 05:02:19.677729 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 181/381] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:02:19 2021] GET /compute/v2.1/servers/68e65823-58dc-4f2f-b814-bdd12dee87ad => generated 1461 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:02:19.909810 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [req-6a4a3e67-9f97-4efb-bd67-40e7dd54d49c req-ed577031-d364-4cb9-808e-22eab931c4b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68e65823-58dc-4f2f-b814-bdd12dee87ad", "name": "network-vif-deleted", "tag": "c64c00ef-0601-4ce8-827f-7c769d727b0d"}]} {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:02:19.912130 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 05:02:19.912130 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: warnings.warn(msg) Feb 19 05:02:19.922022 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [req-6a4a3e67-9f97-4efb-bd67-40e7dd54d49c req-ed577031-d364-4cb9-808e-22eab931c4b2 service nova] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:02:19.922537 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [req-6a4a3e67-9f97-4efb-bd67-40e7dd54d49c req-ed577031-d364-4cb9-808e-22eab931c4b2 service nova] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:02:19.942672 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.compute.server_external_events [req-6a4a3e67-9f97-4efb-bd67-40e7dd54d49c req-ed577031-d364-4cb9-808e-22eab931c4b2 service nova] Creating event network-vif-deleted:c64c00ef-0601-4ce8-827f-7c769d727b0d for instance 68e65823-58dc-4f2f-b814-bdd12dee87ad on hv-cinder-77642 Feb 19 05:02:19.948769 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [req-6a4a3e67-9f97-4efb-bd67-40e7dd54d49c req-ed577031-d364-4cb9-808e-22eab931c4b2 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043791 Feb 19 05:02:19.949477 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 182/382] 10.222.0.47 () {64 vars in 1308 bytes} [Fri Feb 19 05:02:19 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 19 05:02:20.322285 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-fb148cb0-8d06-468c-93ae-4d3712fc68c2 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:02:20.323073 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-fb148cb0-8d06-468c-93ae-4d3712fc68c2 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] [instance: d49e68e7-1b06-45d5-b811-440fe0435ed4] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:02:20.331748 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-fb148cb0-8d06-468c-93ae-4d3712fc68c2 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:02:20.332266 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-fb148cb0-8d06-468c-93ae-4d3712fc68c2 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:02:20.333128 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-fb148cb0-8d06-468c-93ae-4d3712fc68c2 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:02:20.333626 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-fb148cb0-8d06-468c-93ae-4d3712fc68c2 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:02:20.589303 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-fb148cb0-8d06-468c-93ae-4d3712fc68c2 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628d846121a14be78329ccc727c8869d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa473e12960449bbb0713a709e0abe4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:02:20.599952 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-fb148cb0-8d06-468c-93ae-4d3712fc68c2 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] 10.222.0.47 "GET /compute/v2.1/servers/d49e68e7-1b06-45d5-b811-440fe0435ed4" status: 200 len: 1318 microversion: 2.1 time: 0.282797 Feb 19 05:02:20.600678 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 183/383] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:02:20 2021] GET /compute/v2.1/servers/d49e68e7-1b06-45d5-b811-440fe0435ed4 => generated 1318 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 05:02:20.605777 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-9869e99a-67a3-4c18-bfdb-6af67878e7a4 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:02:20.606463 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-9869e99a-67a3-4c18-bfdb-6af67878e7a4 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] [instance: 798b77ff-c3ca-4c65-a120-db12ad953621] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:02:20.615479 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-9869e99a-67a3-4c18-bfdb-6af67878e7a4 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:02:20.615997 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-9869e99a-67a3-4c18-bfdb-6af67878e7a4 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:02:20.616910 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-9869e99a-67a3-4c18-bfdb-6af67878e7a4 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:02:20.617321 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-9869e99a-67a3-4c18-bfdb-6af67878e7a4 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:02:20.895234 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-9869e99a-67a3-4c18-bfdb-6af67878e7a4 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:02:20.905932 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-9869e99a-67a3-4c18-bfdb-6af67878e7a4 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:02:20.910925 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-9869e99a-67a3-4c18-bfdb-6af67878e7a4 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:02:20.912283 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-9869e99a-67a3-4c18-bfdb-6af67878e7a4 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] 10.222.0.47 "GET /compute/v2.1/servers/798b77ff-c3ca-4c65-a120-db12ad953621" status: 200 len: 1725 microversion: 2.20 time: 0.310564 Feb 19 05:02:20.912926 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 184/384] 10.222.0.47 () {60 vars in 1267 bytes} [Fri Feb 19 05:02:20 2021] GET /compute/v2.1/servers/798b77ff-c3ca-4c65-a120-db12ad953621 => generated 1725 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 05:02:20.917726 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-17c7ed63-14f8-4bbe-83a9-e974959e621a tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:02:20.918666 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-17c7ed63-14f8-4bbe-83a9-e974959e621a tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] [instance: 68e65823-58dc-4f2f-b814-bdd12dee87ad] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:02:20.937946 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-17c7ed63-14f8-4bbe-83a9-e974959e621a tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:02:20.938460 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-17c7ed63-14f8-4bbe-83a9-e974959e621a tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:02:20.939364 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-17c7ed63-14f8-4bbe-83a9-e974959e621a tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:02:20.939940 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-17c7ed63-14f8-4bbe-83a9-e974959e621a tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:02:21.095745 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-17c7ed63-14f8-4bbe-83a9-e974959e621a tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ac58c346fa4d569782f22a3394e22a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f6827c056bf4dc0b68a527187f4be9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:02:21.108839 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-17c7ed63-14f8-4bbe-83a9-e974959e621a tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] 10.222.0.47 "GET /compute/v2.1/servers/68e65823-58dc-4f2f-b814-bdd12dee87ad" status: 200 len: 1461 microversion: 2.1 time: 0.194752 Feb 19 05:02:21.109666 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 185/385] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:02:20 2021] GET /compute/v2.1/servers/68e65823-58dc-4f2f-b814-bdd12dee87ad => generated 1461 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:02:21.629705 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-c2551ece-b10c-47e2-a295-48558cabd42b tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:02:21.630928 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-c2551ece-b10c-47e2-a295-48558cabd42b tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] [instance: d49e68e7-1b06-45d5-b811-440fe0435ed4] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:02:21.642712 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-c2551ece-b10c-47e2-a295-48558cabd42b tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:02:21.644843 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-c2551ece-b10c-47e2-a295-48558cabd42b tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:02:21.646431 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-c2551ece-b10c-47e2-a295-48558cabd42b tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:02:21.647744 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-c2551ece-b10c-47e2-a295-48558cabd42b tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:02:22.246916 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-7e4b36a2-cb15-4e57-83ae-e6106b615171 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] 10.222.0.47 "POST /compute/v2.1/servers/74c5a115-b174-49fe-9b75-574e484a09e2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.940890 Feb 19 05:02:22.248205 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 201/386] 10.222.0.47 () {60 vars in 1313 bytes} [Fri Feb 19 05:02:19 2021] POST /compute/v2.1/servers/74c5a115-b174-49fe-9b75-574e484a09e2/os-volume_attachments => generated 194 bytes in 2944 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 05:02:22.276336 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-9e78ae59-6def-4de6-a474-899d952f5837 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:02:22.277935 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-9e78ae59-6def-4de6-a474-899d952f5837 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] [instance: 798b77ff-c3ca-4c65-a120-db12ad953621] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:02:22.313340 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-9e78ae59-6def-4de6-a474-899d952f5837 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:02:22.314347 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-9e78ae59-6def-4de6-a474-899d952f5837 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:02:22.316673 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-9e78ae59-6def-4de6-a474-899d952f5837 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:02:22.317589 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-9e78ae59-6def-4de6-a474-899d952f5837 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:02:23.049828 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-c2551ece-b10c-47e2-a295-48558cabd42b tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628d846121a14be78329ccc727c8869d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa473e12960449bbb0713a709e0abe4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:02:23.105377 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-c2551ece-b10c-47e2-a295-48558cabd42b tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] 10.222.0.47 "GET /compute/v2.1/servers/d49e68e7-1b06-45d5-b811-440fe0435ed4" status: 200 len: 1318 microversion: 2.1 time: 1.481506 Feb 19 05:02:23.120968 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 186/387] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:02:21 2021] GET /compute/v2.1/servers/d49e68e7-1b06-45d5-b811-440fe0435ed4 => generated 1318 bytes in 1498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:02:23.133592 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-32e148ed-f35b-4b23-b3d6-633905a6da55 tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:02:23.140798 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-32e148ed-f35b-4b23-b3d6-633905a6da55 tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] [instance: 68e65823-58dc-4f2f-b814-bdd12dee87ad] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:02:23.158189 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-32e148ed-f35b-4b23-b3d6-633905a6da55 tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:02:23.160774 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-32e148ed-f35b-4b23-b3d6-633905a6da55 tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:02:23.163229 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-32e148ed-f35b-4b23-b3d6-633905a6da55 tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:02:23.165351 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-32e148ed-f35b-4b23-b3d6-633905a6da55 tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:02:23.367379 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-32e148ed-f35b-4b23-b3d6-633905a6da55 tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:02:23.369616 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-32e148ed-f35b-4b23-b3d6-633905a6da55 tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:02:23.370717 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.objects.instance [None req-32e148ed-f35b-4b23-b3d6-633905a6da55 tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Lazy-loading 'fault' on Instance uuid 68e65823-58dc-4f2f-b814-bdd12dee87ad {{(pid=98153) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Feb 19 05:02:23.633066 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-9e78ae59-6def-4de6-a474-899d952f5837 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:02:23.642399 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-32e148ed-f35b-4b23-b3d6-633905a6da55 tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ac58c346fa4d569782f22a3394e22a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f6827c056bf4dc0b68a527187f4be9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:02:23.667842 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-32e148ed-f35b-4b23-b3d6-633905a6da55 tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] 10.222.0.47 "GET /compute/v2.1/servers/68e65823-58dc-4f2f-b814-bdd12dee87ad" status: 200 len: 1303 microversion: 2.1 time: 0.544252 Feb 19 05:02:23.669170 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-9e78ae59-6def-4de6-a474-899d952f5837 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:02:23.669644 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 187/388] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:02:23 2021] GET /compute/v2.1/servers/68e65823-58dc-4f2f-b814-bdd12dee87ad => generated 1303 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:02:23.672866 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-9e78ae59-6def-4de6-a474-899d952f5837 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:02:23.680292 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-57c67e6f-4867-4bfd-bcec-0ecf9a97ee0e tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:02:23.681166 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-9e78ae59-6def-4de6-a474-899d952f5837 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] 10.222.0.47 "GET /compute/v2.1/servers/798b77ff-c3ca-4c65-a120-db12ad953621" status: 200 len: 1725 microversion: 2.20 time: 1.430299 Feb 19 05:02:23.685414 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 202/389] 10.222.0.47 () {60 vars in 1267 bytes} [Fri Feb 19 05:02:22 2021] GET /compute/v2.1/servers/798b77ff-c3ca-4c65-a120-db12ad953621 => generated 1725 bytes in 1437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 05:02:23.709754 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-57c67e6f-4867-4bfd-bcec-0ecf9a97ee0e tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:02:23.710259 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-57c67e6f-4867-4bfd-bcec-0ecf9a97ee0e tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:02:23.782744 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-57c67e6f-4867-4bfd-bcec-0ecf9a97ee0e tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] [instance: be65ea57-bc8d-4bce-80c3-33d8b6007ed1] Going to try to stop instance {{(pid=98153) force_stop /opt/stack/nova/nova/compute/api.py:2580}} Feb 19 05:02:23.881242 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-57c67e6f-4867-4bfd-bcec-0ecf9a97ee0e tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] 10.222.0.47 "POST /compute/v2.1/servers/be65ea57-bc8d-4bce-80c3-33d8b6007ed1/action" status: 202 len: 0 microversion: 2.1 time: 0.209677 Feb 19 05:02:23.882321 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 188/390] 10.222.0.47 () {60 vars in 1268 bytes} [Fri Feb 19 05:02:23 2021] POST /compute/v2.1/servers/be65ea57-bc8d-4bce-80c3-33d8b6007ed1/action => generated 0 bytes in 212 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 19 05:02:23.892207 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-ef74703d-77c6-4ba9-809b-3c07aa645f46 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:02:23.894559 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-ef74703d-77c6-4ba9-809b-3c07aa645f46 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] [instance: be65ea57-bc8d-4bce-80c3-33d8b6007ed1] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:02:23.905124 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-ef74703d-77c6-4ba9-809b-3c07aa645f46 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:02:23.905916 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-ef74703d-77c6-4ba9-809b-3c07aa645f46 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:02:23.907391 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-ef74703d-77c6-4ba9-809b-3c07aa645f46 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:02:23.908958 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-ef74703d-77c6-4ba9-809b-3c07aa645f46 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:02:24.152249 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-748711f1-369b-401e-b81e-a1d9ef392ea9 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:02:24.154022 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-748711f1-369b-401e-b81e-a1d9ef392ea9 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] [instance: d49e68e7-1b06-45d5-b811-440fe0435ed4] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:02:24.163378 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-748711f1-369b-401e-b81e-a1d9ef392ea9 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:02:24.164074 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-748711f1-369b-401e-b81e-a1d9ef392ea9 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:02:24.165299 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-748711f1-369b-401e-b81e-a1d9ef392ea9 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:02:24.165966 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-748711f1-369b-401e-b81e-a1d9ef392ea9 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:02:24.982115 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-ef74703d-77c6-4ba9-809b-3c07aa645f46 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3274478c0a421895f43618dc827ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50941a0cab243e9a320ff22a7648de6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:02:24.999081 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-ef74703d-77c6-4ba9-809b-3c07aa645f46 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] 10.222.0.47 "GET /compute/v2.1/servers/be65ea57-bc8d-4bce-80c3-33d8b6007ed1" status: 200 len: 1721 microversion: 2.1 time: 1.108113 Feb 19 05:02:25.005138 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 203/391] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:02:23 2021] GET /compute/v2.1/servers/be65ea57-bc8d-4bce-80c3-33d8b6007ed1 => generated 1721 bytes in 1117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:02:25.014284 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-07e03bcd-2f71-4b14-b9e5-bf0efd7473ef tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:02:25.016417 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-07e03bcd-2f71-4b14-b9e5-bf0efd7473ef tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] [instance: 68e65823-58dc-4f2f-b814-bdd12dee87ad] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:02:25.019955 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-748711f1-369b-401e-b81e-a1d9ef392ea9 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628d846121a14be78329ccc727c8869d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa473e12960449bbb0713a709e0abe4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:02:25.029968 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-07e03bcd-2f71-4b14-b9e5-bf0efd7473ef tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:02:25.030516 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-07e03bcd-2f71-4b14-b9e5-bf0efd7473ef tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:02:25.031705 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-07e03bcd-2f71-4b14-b9e5-bf0efd7473ef tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:02:25.032356 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-07e03bcd-2f71-4b14-b9e5-bf0efd7473ef tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:02:25.037888 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-748711f1-369b-401e-b81e-a1d9ef392ea9 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] 10.222.0.47 "GET /compute/v2.1/servers/d49e68e7-1b06-45d5-b811-440fe0435ed4" status: 200 len: 1318 microversion: 2.1 time: 0.890272 Feb 19 05:02:25.038918 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 189/392] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:02:24 2021] GET /compute/v2.1/servers/d49e68e7-1b06-45d5-b811-440fe0435ed4 => generated 1318 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:02:25.045276 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-a55fc2d6-4122-47f9-9489-5614459e7ab8 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:02:25.045955 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-a55fc2d6-4122-47f9-9489-5614459e7ab8 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] [instance: 798b77ff-c3ca-4c65-a120-db12ad953621] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:02:25.057423 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-a55fc2d6-4122-47f9-9489-5614459e7ab8 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:02:25.057944 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-a55fc2d6-4122-47f9-9489-5614459e7ab8 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:02:25.058824 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-a55fc2d6-4122-47f9-9489-5614459e7ab8 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:02:25.059354 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-a55fc2d6-4122-47f9-9489-5614459e7ab8 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:02:25.106316 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.wsgi [None req-07e03bcd-2f71-4b14-b9e5-bf0efd7473ef tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] HTTP exception thrown: Instance 68e65823-58dc-4f2f-b814-bdd12dee87ad could not be found. Feb 19 05:02:25.107419 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-07e03bcd-2f71-4b14-b9e5-bf0efd7473ef tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] Returning 404 to user: Instance 68e65823-58dc-4f2f-b814-bdd12dee87ad could not be found. {{(pid=98154) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 19 05:02:25.108551 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-07e03bcd-2f71-4b14-b9e5-bf0efd7473ef tempest-VolumesActionsTest-1700994173 tempest-VolumesActionsTest-1700994173-project] 10.222.0.47 "GET /compute/v2.1/servers/68e65823-58dc-4f2f-b814-bdd12dee87ad" status: 404 len: 111 microversion: 2.1 time: 0.101995 Feb 19 05:02:25.109497 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 204/393] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:02:25 2021] GET /compute/v2.1/servers/68e65823-58dc-4f2f-b814-bdd12dee87ad => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 05:02:25.410091 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-a55fc2d6-4122-47f9-9489-5614459e7ab8 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:02:25.422569 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-a55fc2d6-4122-47f9-9489-5614459e7ab8 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:02:25.425262 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-a55fc2d6-4122-47f9-9489-5614459e7ab8 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:02:25.426943 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-a55fc2d6-4122-47f9-9489-5614459e7ab8 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] 10.222.0.47 "GET /compute/v2.1/servers/798b77ff-c3ca-4c65-a120-db12ad953621" status: 200 len: 1725 microversion: 2.20 time: 0.386681 Feb 19 05:02:25.427695 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 190/394] 10.222.0.47 () {60 vars in 1267 bytes} [Fri Feb 19 05:02:25 2021] GET /compute/v2.1/servers/798b77ff-c3ca-4c65-a120-db12ad953621 => generated 1725 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 05:02:26.026477 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-69c42faf-6d91-4419-aaf0-2dc987cea43e tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:02:26.027957 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-69c42faf-6d91-4419-aaf0-2dc987cea43e tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] [instance: be65ea57-bc8d-4bce-80c3-33d8b6007ed1] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:02:26.037932 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-69c42faf-6d91-4419-aaf0-2dc987cea43e tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:02:26.038782 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-69c42faf-6d91-4419-aaf0-2dc987cea43e tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:02:26.039747 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-69c42faf-6d91-4419-aaf0-2dc987cea43e tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:02:26.040304 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-69c42faf-6d91-4419-aaf0-2dc987cea43e tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:02:26.077996 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-eccd1fd7-5fd8-4f71-aa33-75240ac4f2f4 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:02:26.081571 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-eccd1fd7-5fd8-4f71-aa33-75240ac4f2f4 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] [instance: d49e68e7-1b06-45d5-b811-440fe0435ed4] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:02:26.100708 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-eccd1fd7-5fd8-4f71-aa33-75240ac4f2f4 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:02:26.101950 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-eccd1fd7-5fd8-4f71-aa33-75240ac4f2f4 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:02:26.103689 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-eccd1fd7-5fd8-4f71-aa33-75240ac4f2f4 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:02:26.104970 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-eccd1fd7-5fd8-4f71-aa33-75240ac4f2f4 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:02:26.626654 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-eccd1fd7-5fd8-4f71-aa33-75240ac4f2f4 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628d846121a14be78329ccc727c8869d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa473e12960449bbb0713a709e0abe4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:02:26.642480 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-eccd1fd7-5fd8-4f71-aa33-75240ac4f2f4 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] 10.222.0.47 "GET /compute/v2.1/servers/d49e68e7-1b06-45d5-b811-440fe0435ed4" status: 200 len: 1318 microversion: 2.1 time: 0.572539 Feb 19 05:02:26.659748 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 191/395] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:02:26 2021] GET /compute/v2.1/servers/d49e68e7-1b06-45d5-b811-440fe0435ed4 => generated 1318 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:02:26.672283 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-6ebd57ab-ccb6-40f2-94bb-4a0d29848a6d tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:02:26.673263 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-6ebd57ab-ccb6-40f2-94bb-4a0d29848a6d tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] [instance: 798b77ff-c3ca-4c65-a120-db12ad953621] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:02:26.675071 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-69c42faf-6d91-4419-aaf0-2dc987cea43e tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3274478c0a421895f43618dc827ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50941a0cab243e9a320ff22a7648de6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:02:26.693235 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-6ebd57ab-ccb6-40f2-94bb-4a0d29848a6d tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:02:26.693704 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-6ebd57ab-ccb6-40f2-94bb-4a0d29848a6d tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:02:26.694908 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-6ebd57ab-ccb6-40f2-94bb-4a0d29848a6d tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:02:26.695812 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-6ebd57ab-ccb6-40f2-94bb-4a0d29848a6d tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:02:26.714918 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-69c42faf-6d91-4419-aaf0-2dc987cea43e tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] 10.222.0.47 "GET /compute/v2.1/servers/be65ea57-bc8d-4bce-80c3-33d8b6007ed1" status: 200 len: 1721 microversion: 2.1 time: 0.692904 Feb 19 05:02:26.742212 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 205/396] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:02:26 2021] GET /compute/v2.1/servers/be65ea57-bc8d-4bce-80c3-33d8b6007ed1 => generated 1721 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:02:27.059638 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-6ebd57ab-ccb6-40f2-94bb-4a0d29848a6d tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:02:27.074163 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-6ebd57ab-ccb6-40f2-94bb-4a0d29848a6d tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:02:27.075846 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-6ebd57ab-ccb6-40f2-94bb-4a0d29848a6d tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:02:27.077145 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-6ebd57ab-ccb6-40f2-94bb-4a0d29848a6d tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] 10.222.0.47 "GET /compute/v2.1/servers/798b77ff-c3ca-4c65-a120-db12ad953621" status: 200 len: 1725 microversion: 2.20 time: 0.415953 Feb 19 05:02:27.078121 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 192/397] 10.222.0.47 () {60 vars in 1267 bytes} [Fri Feb 19 05:02:26 2021] GET /compute/v2.1/servers/798b77ff-c3ca-4c65-a120-db12ad953621 => generated 1725 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 05:02:27.670893 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-e4348c45-0c35-4a43-a7d4-fa3a8abccb9f tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:02:27.671946 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-e4348c45-0c35-4a43-a7d4-fa3a8abccb9f tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] [instance: d49e68e7-1b06-45d5-b811-440fe0435ed4] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:02:27.682718 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-e4348c45-0c35-4a43-a7d4-fa3a8abccb9f tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:02:27.684006 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-e4348c45-0c35-4a43-a7d4-fa3a8abccb9f tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:02:27.685535 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-e4348c45-0c35-4a43-a7d4-fa3a8abccb9f tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:02:27.686142 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-e4348c45-0c35-4a43-a7d4-fa3a8abccb9f tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:02:27.770621 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-5b0c0e8a-1d2f-4ce2-aa0e-031049275b86 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:02:27.772547 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-5b0c0e8a-1d2f-4ce2-aa0e-031049275b86 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] [instance: be65ea57-bc8d-4bce-80c3-33d8b6007ed1] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:02:27.811182 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-5b0c0e8a-1d2f-4ce2-aa0e-031049275b86 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:02:27.818938 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-5b0c0e8a-1d2f-4ce2-aa0e-031049275b86 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:02:27.820705 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-5b0c0e8a-1d2f-4ce2-aa0e-031049275b86 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:02:27.821597 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-5b0c0e8a-1d2f-4ce2-aa0e-031049275b86 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:02:28.175826 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-e4348c45-0c35-4a43-a7d4-fa3a8abccb9f tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628d846121a14be78329ccc727c8869d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa473e12960449bbb0713a709e0abe4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:02:28.209124 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-e4348c45-0c35-4a43-a7d4-fa3a8abccb9f tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] 10.222.0.47 "GET /compute/v2.1/servers/d49e68e7-1b06-45d5-b811-440fe0435ed4" status: 200 len: 1318 microversion: 2.1 time: 0.544677 Feb 19 05:02:28.215080 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 206/398] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:02:27 2021] GET /compute/v2.1/servers/d49e68e7-1b06-45d5-b811-440fe0435ed4 => generated 1318 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:02:28.225816 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [req-2cd99c01-1c1e-46b9-b848-26669c0d581b req-34631c8e-1065-4113-80ed-fb36891b9406 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d49e68e7-1b06-45d5-b811-440fe0435ed4", "name": "network-vif-plugged", "status": "completed", "tag": "8b909732-be36-45f2-ab6d-689515c337d4"}]} {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:02:28.229508 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 05:02:28.229508 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: warnings.warn(msg) Feb 19 05:02:28.249320 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [req-2cd99c01-1c1e-46b9-b848-26669c0d581b req-34631c8e-1065-4113-80ed-fb36891b9406 service nova] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:02:28.250292 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [req-2cd99c01-1c1e-46b9-b848-26669c0d581b req-34631c8e-1065-4113-80ed-fb36891b9406 service nova] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:02:28.289651 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.compute.server_external_events [req-2cd99c01-1c1e-46b9-b848-26669c0d581b req-34631c8e-1065-4113-80ed-fb36891b9406 service nova] Creating event network-vif-plugged:8b909732-be36-45f2-ab6d-689515c337d4 for instance d49e68e7-1b06-45d5-b811-440fe0435ed4 on hv-cinder-77642 Feb 19 05:02:28.299393 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [req-2cd99c01-1c1e-46b9-b848-26669c0d581b req-34631c8e-1065-4113-80ed-fb36891b9406 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081389 Feb 19 05:02:28.301752 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 207/399] 10.222.0.47 () {64 vars in 1308 bytes} [Fri Feb 19 05:02:28 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 05:02:28.313081 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-a618a44f-41b9-47ce-849e-370b289f1782 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:02:28.315370 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-a618a44f-41b9-47ce-849e-370b289f1782 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] [instance: 798b77ff-c3ca-4c65-a120-db12ad953621] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:02:28.332834 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-5b0c0e8a-1d2f-4ce2-aa0e-031049275b86 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3274478c0a421895f43618dc827ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50941a0cab243e9a320ff22a7648de6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:02:28.334030 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-a618a44f-41b9-47ce-849e-370b289f1782 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:02:28.334885 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-a618a44f-41b9-47ce-849e-370b289f1782 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:02:28.336387 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-a618a44f-41b9-47ce-849e-370b289f1782 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:02:28.337425 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-a618a44f-41b9-47ce-849e-370b289f1782 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:02:28.348358 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-5b0c0e8a-1d2f-4ce2-aa0e-031049275b86 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] 10.222.0.47 "GET /compute/v2.1/servers/be65ea57-bc8d-4bce-80c3-33d8b6007ed1" status: 200 len: 1721 microversion: 2.1 time: 0.588839 Feb 19 05:02:28.357356 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 193/400] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:02:27 2021] GET /compute/v2.1/servers/be65ea57-bc8d-4bce-80c3-33d8b6007ed1 => generated 1721 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:02:28.644533 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-a618a44f-41b9-47ce-849e-370b289f1782 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:02:28.656073 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-a618a44f-41b9-47ce-849e-370b289f1782 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:02:28.657647 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-a618a44f-41b9-47ce-849e-370b289f1782 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:02:28.659480 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-a618a44f-41b9-47ce-849e-370b289f1782 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] 10.222.0.47 "GET /compute/v2.1/servers/798b77ff-c3ca-4c65-a120-db12ad953621" status: 200 len: 1746 microversion: 2.20 time: 0.355697 Feb 19 05:02:28.675364 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 208/401] 10.222.0.47 () {60 vars in 1267 bytes} [Fri Feb 19 05:02:28 2021] GET /compute/v2.1/servers/798b77ff-c3ca-4c65-a120-db12ad953621 => generated 1746 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 05:02:29.233133 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-510917c3-75c4-41e7-8cbd-a2f4a986ccda tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:02:29.233807 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-510917c3-75c4-41e7-8cbd-a2f4a986ccda tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] [instance: d49e68e7-1b06-45d5-b811-440fe0435ed4] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:02:29.242761 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-510917c3-75c4-41e7-8cbd-a2f4a986ccda tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:02:29.243546 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-510917c3-75c4-41e7-8cbd-a2f4a986ccda tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:02:29.244414 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-510917c3-75c4-41e7-8cbd-a2f4a986ccda tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:02:29.245003 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-510917c3-75c4-41e7-8cbd-a2f4a986ccda tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:02:29.367943 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-96b728bb-a970-49d6-a438-3025235f0b31 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:02:29.368612 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-96b728bb-a970-49d6-a438-3025235f0b31 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] [instance: be65ea57-bc8d-4bce-80c3-33d8b6007ed1] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:02:29.377725 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-96b728bb-a970-49d6-a438-3025235f0b31 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:02:29.378237 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-96b728bb-a970-49d6-a438-3025235f0b31 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:02:29.379107 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-96b728bb-a970-49d6-a438-3025235f0b31 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:02:29.381075 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-96b728bb-a970-49d6-a438-3025235f0b31 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:02:29.665967 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-510917c3-75c4-41e7-8cbd-a2f4a986ccda tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628d846121a14be78329ccc727c8869d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa473e12960449bbb0713a709e0abe4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:02:29.676243 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-510917c3-75c4-41e7-8cbd-a2f4a986ccda tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] 10.222.0.47 "GET /compute/v2.1/servers/d49e68e7-1b06-45d5-b811-440fe0435ed4" status: 200 len: 1318 microversion: 2.1 time: 0.447248 Feb 19 05:02:29.676784 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 194/402] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:02:29 2021] GET /compute/v2.1/servers/d49e68e7-1b06-45d5-b811-440fe0435ed4 => generated 1318 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:02:29.697432 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-9a01d23f-8b8f-47c1-b40a-83b9573dfb20 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:02:29.698648 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-9a01d23f-8b8f-47c1-b40a-83b9573dfb20 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] [instance: 798b77ff-c3ca-4c65-a120-db12ad953621] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:02:29.721341 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-9a01d23f-8b8f-47c1-b40a-83b9573dfb20 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:02:29.722075 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-9a01d23f-8b8f-47c1-b40a-83b9573dfb20 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:02:29.722843 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-9a01d23f-8b8f-47c1-b40a-83b9573dfb20 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:02:29.723365 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-9a01d23f-8b8f-47c1-b40a-83b9573dfb20 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:02:29.813300 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-96b728bb-a970-49d6-a438-3025235f0b31 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3274478c0a421895f43618dc827ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50941a0cab243e9a320ff22a7648de6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:02:29.833178 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-96b728bb-a970-49d6-a438-3025235f0b31 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] 10.222.0.47 "GET /compute/v2.1/servers/be65ea57-bc8d-4bce-80c3-33d8b6007ed1" status: 200 len: 1721 microversion: 2.1 time: 0.469312 Feb 19 05:02:29.834151 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 209/403] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:02:29 2021] GET /compute/v2.1/servers/be65ea57-bc8d-4bce-80c3-33d8b6007ed1 => generated 1721 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 05:02:30.052987 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-9a01d23f-8b8f-47c1-b40a-83b9573dfb20 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:02:30.064436 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-9a01d23f-8b8f-47c1-b40a-83b9573dfb20 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:02:30.066986 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-9a01d23f-8b8f-47c1-b40a-83b9573dfb20 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:02:30.068490 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-9a01d23f-8b8f-47c1-b40a-83b9573dfb20 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] 10.222.0.47 "GET /compute/v2.1/servers/798b77ff-c3ca-4c65-a120-db12ad953621" status: 200 len: 1746 microversion: 2.20 time: 0.380627 Feb 19 05:02:30.069266 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 195/404] 10.222.0.47 () {60 vars in 1267 bytes} [Fri Feb 19 05:02:29 2021] GET /compute/v2.1/servers/798b77ff-c3ca-4c65-a120-db12ad953621 => generated 1746 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 19 05:02:30.697394 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-2c57c703-ec62-4d12-bbe3-1f93b3c533cb tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:02:30.698581 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-2c57c703-ec62-4d12-bbe3-1f93b3c533cb tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] [instance: d49e68e7-1b06-45d5-b811-440fe0435ed4] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:02:30.708319 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-2c57c703-ec62-4d12-bbe3-1f93b3c533cb tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:02:30.708940 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-2c57c703-ec62-4d12-bbe3-1f93b3c533cb tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:02:30.710371 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-2c57c703-ec62-4d12-bbe3-1f93b3c533cb tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:02:30.711219 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-2c57c703-ec62-4d12-bbe3-1f93b3c533cb tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:02:30.855180 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-7afe5a6f-24cb-49a2-849c-673553f52982 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:02:30.856125 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-7afe5a6f-24cb-49a2-849c-673553f52982 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] [instance: be65ea57-bc8d-4bce-80c3-33d8b6007ed1] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:02:30.869882 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-7afe5a6f-24cb-49a2-849c-673553f52982 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:02:30.870963 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-7afe5a6f-24cb-49a2-849c-673553f52982 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:02:30.872282 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-7afe5a6f-24cb-49a2-849c-673553f52982 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:02:30.873141 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-7afe5a6f-24cb-49a2-849c-673553f52982 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:02:31.146333 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-2c57c703-ec62-4d12-bbe3-1f93b3c533cb tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628d846121a14be78329ccc727c8869d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa473e12960449bbb0713a709e0abe4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:02:31.172345 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-2c57c703-ec62-4d12-bbe3-1f93b3c533cb tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] 10.222.0.47 "GET /compute/v2.1/servers/d49e68e7-1b06-45d5-b811-440fe0435ed4" status: 200 len: 1318 microversion: 2.1 time: 0.481270 Feb 19 05:02:31.173940 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 210/405] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:02:30 2021] GET /compute/v2.1/servers/d49e68e7-1b06-45d5-b811-440fe0435ed4 => generated 1318 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:02:31.181105 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-2c590ba2-4354-4dc1-ac6f-251011a93e5f tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:02:31.182773 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-2c590ba2-4354-4dc1-ac6f-251011a93e5f tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] [instance: 798b77ff-c3ca-4c65-a120-db12ad953621] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:02:31.200287 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-2c590ba2-4354-4dc1-ac6f-251011a93e5f tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:02:31.201337 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-2c590ba2-4354-4dc1-ac6f-251011a93e5f tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:02:31.203125 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-2c590ba2-4354-4dc1-ac6f-251011a93e5f tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:02:31.208527 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-2c590ba2-4354-4dc1-ac6f-251011a93e5f tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:02:31.301446 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-7afe5a6f-24cb-49a2-849c-673553f52982 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3274478c0a421895f43618dc827ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50941a0cab243e9a320ff22a7648de6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:02:31.326824 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-7afe5a6f-24cb-49a2-849c-673553f52982 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] 10.222.0.47 "GET /compute/v2.1/servers/be65ea57-bc8d-4bce-80c3-33d8b6007ed1" status: 200 len: 1721 microversion: 2.1 time: 0.475773 Feb 19 05:02:31.329295 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 196/406] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:02:30 2021] GET /compute/v2.1/servers/be65ea57-bc8d-4bce-80c3-33d8b6007ed1 => generated 1721 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 05:02:31.544380 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-2c590ba2-4354-4dc1-ac6f-251011a93e5f tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:02:31.554882 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-2c590ba2-4354-4dc1-ac6f-251011a93e5f tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:02:31.556514 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-2c590ba2-4354-4dc1-ac6f-251011a93e5f tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:02:31.557777 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-2c590ba2-4354-4dc1-ac6f-251011a93e5f tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] 10.222.0.47 "GET /compute/v2.1/servers/798b77ff-c3ca-4c65-a120-db12ad953621" status: 200 len: 1746 microversion: 2.20 time: 0.382562 Feb 19 05:02:31.558399 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 211/407] 10.222.0.47 () {60 vars in 1267 bytes} [Fri Feb 19 05:02:31 2021] GET /compute/v2.1/servers/798b77ff-c3ca-4c65-a120-db12ad953621 => generated 1746 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 05:02:32.206472 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-e0b0e8ba-0c00-4e8a-8e92-6b117e1ef0b1 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:02:32.207971 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-e0b0e8ba-0c00-4e8a-8e92-6b117e1ef0b1 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] [instance: d49e68e7-1b06-45d5-b811-440fe0435ed4] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:02:32.219657 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-e0b0e8ba-0c00-4e8a-8e92-6b117e1ef0b1 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:02:32.220165 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-e0b0e8ba-0c00-4e8a-8e92-6b117e1ef0b1 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:02:32.221609 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-e0b0e8ba-0c00-4e8a-8e92-6b117e1ef0b1 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:02:32.222071 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-e0b0e8ba-0c00-4e8a-8e92-6b117e1ef0b1 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:02:32.368683 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-b36ae9a1-a324-4a5f-a42e-dd53f1ff7b29 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:02:32.370694 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-b36ae9a1-a324-4a5f-a42e-dd53f1ff7b29 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] [instance: be65ea57-bc8d-4bce-80c3-33d8b6007ed1] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:02:32.391001 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-b36ae9a1-a324-4a5f-a42e-dd53f1ff7b29 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:02:32.392208 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-b36ae9a1-a324-4a5f-a42e-dd53f1ff7b29 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:02:32.395256 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-b36ae9a1-a324-4a5f-a42e-dd53f1ff7b29 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:02:32.396206 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-b36ae9a1-a324-4a5f-a42e-dd53f1ff7b29 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:02:32.832046 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-e0b0e8ba-0c00-4e8a-8e92-6b117e1ef0b1 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628d846121a14be78329ccc727c8869d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa473e12960449bbb0713a709e0abe4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:02:32.897495 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-e0b0e8ba-0c00-4e8a-8e92-6b117e1ef0b1 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] 10.222.0.47 "GET /compute/v2.1/servers/d49e68e7-1b06-45d5-b811-440fe0435ed4" status: 200 len: 1318 microversion: 2.1 time: 0.695566 Feb 19 05:02:32.916915 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 197/408] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:02:32 2021] GET /compute/v2.1/servers/d49e68e7-1b06-45d5-b811-440fe0435ed4 => generated 1318 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:02:32.933468 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-05a81506-7f37-439a-9ecc-bc5ddb71e735 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:02:32.943282 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-05a81506-7f37-439a-9ecc-bc5ddb71e735 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] [instance: 798b77ff-c3ca-4c65-a120-db12ad953621] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:02:32.975891 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-05a81506-7f37-439a-9ecc-bc5ddb71e735 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:02:32.976545 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-05a81506-7f37-439a-9ecc-bc5ddb71e735 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:02:32.977630 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-05a81506-7f37-439a-9ecc-bc5ddb71e735 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:02:32.987535 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-05a81506-7f37-439a-9ecc-bc5ddb71e735 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:02:33.070575 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-b36ae9a1-a324-4a5f-a42e-dd53f1ff7b29 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3274478c0a421895f43618dc827ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50941a0cab243e9a320ff22a7648de6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:02:33.088479 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-b36ae9a1-a324-4a5f-a42e-dd53f1ff7b29 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] 10.222.0.47 "GET /compute/v2.1/servers/be65ea57-bc8d-4bce-80c3-33d8b6007ed1" status: 200 len: 1721 microversion: 2.1 time: 0.741222 Feb 19 05:02:33.090747 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 212/409] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:02:32 2021] GET /compute/v2.1/servers/be65ea57-bc8d-4bce-80c3-33d8b6007ed1 => generated 1721 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 05:02:33.441567 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-05a81506-7f37-439a-9ecc-bc5ddb71e735 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:02:33.456429 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-05a81506-7f37-439a-9ecc-bc5ddb71e735 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:02:33.458194 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-05a81506-7f37-439a-9ecc-bc5ddb71e735 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:02:33.459568 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-05a81506-7f37-439a-9ecc-bc5ddb71e735 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] 10.222.0.47 "GET /compute/v2.1/servers/798b77ff-c3ca-4c65-a120-db12ad953621" status: 200 len: 1741 microversion: 2.20 time: 0.540976 Feb 19 05:02:33.460451 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 198/410] 10.222.0.47 () {60 vars in 1267 bytes} [Fri Feb 19 05:02:32 2021] GET /compute/v2.1/servers/798b77ff-c3ca-4c65-a120-db12ad953621 => generated 1741 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 05:02:33.935302 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-db94b278-417e-48b9-a165-4898bfc1010c tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:02:33.936350 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-db94b278-417e-48b9-a165-4898bfc1010c tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] [instance: d49e68e7-1b06-45d5-b811-440fe0435ed4] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:02:33.954694 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-db94b278-417e-48b9-a165-4898bfc1010c tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:02:33.959017 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-db94b278-417e-48b9-a165-4898bfc1010c tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:02:33.960962 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-db94b278-417e-48b9-a165-4898bfc1010c tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:02:33.963751 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-db94b278-417e-48b9-a165-4898bfc1010c tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:02:34.116705 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-f2ef10f7-1dc9-4fff-aa1e-4325687678f1 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:02:34.118009 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-f2ef10f7-1dc9-4fff-aa1e-4325687678f1 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] [instance: be65ea57-bc8d-4bce-80c3-33d8b6007ed1] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:02:34.141138 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-f2ef10f7-1dc9-4fff-aa1e-4325687678f1 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:02:34.142051 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-f2ef10f7-1dc9-4fff-aa1e-4325687678f1 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:02:34.145813 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-f2ef10f7-1dc9-4fff-aa1e-4325687678f1 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:02:34.147987 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-f2ef10f7-1dc9-4fff-aa1e-4325687678f1 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:02:34.310876 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-db94b278-417e-48b9-a165-4898bfc1010c tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628d846121a14be78329ccc727c8869d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa473e12960449bbb0713a709e0abe4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:02:34.324637 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-db94b278-417e-48b9-a165-4898bfc1010c tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] 10.222.0.47 "GET /compute/v2.1/servers/d49e68e7-1b06-45d5-b811-440fe0435ed4" status: 200 len: 1509 microversion: 2.1 time: 0.394472 Feb 19 05:02:34.325298 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 213/411] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:02:33 2021] GET /compute/v2.1/servers/d49e68e7-1b06-45d5-b811-440fe0435ed4 => generated 1509 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:02:34.485998 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-2565e397-3962-46f1-9f9d-58624b6b5817 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:02:34.487353 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-2565e397-3962-46f1-9f9d-58624b6b5817 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] [instance: 798b77ff-c3ca-4c65-a120-db12ad953621] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:02:34.512659 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-2565e397-3962-46f1-9f9d-58624b6b5817 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:02:34.513324 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-2565e397-3962-46f1-9f9d-58624b6b5817 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:02:34.514965 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-2565e397-3962-46f1-9f9d-58624b6b5817 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:02:34.514965 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-2565e397-3962-46f1-9f9d-58624b6b5817 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:02:35.626256 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-f2ef10f7-1dc9-4fff-aa1e-4325687678f1 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3274478c0a421895f43618dc827ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50941a0cab243e9a320ff22a7648de6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:02:35.680148 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-f2ef10f7-1dc9-4fff-aa1e-4325687678f1 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] 10.222.0.47 "GET /compute/v2.1/servers/be65ea57-bc8d-4bce-80c3-33d8b6007ed1" status: 200 len: 1721 microversion: 2.1 time: 1.561746 Feb 19 05:02:35.682158 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 199/412] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:02:34 2021] GET /compute/v2.1/servers/be65ea57-bc8d-4bce-80c3-33d8b6007ed1 => generated 1721 bytes in 1571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:02:35.729316 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-4152699a-8edf-4692-a589-847c6d4cc5fc tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:02:35.731756 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-4152699a-8edf-4692-a589-847c6d4cc5fc tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] [instance: 74c5a115-b174-49fe-9b75-574e484a09e2] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:02:35.780934 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-4152699a-8edf-4692-a589-847c6d4cc5fc tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:02:35.789384 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-4152699a-8edf-4692-a589-847c6d4cc5fc tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:02:35.791233 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-4152699a-8edf-4692-a589-847c6d4cc5fc tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:02:35.792516 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-4152699a-8edf-4692-a589-847c6d4cc5fc tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:02:36.016090 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.objects.instance [None req-4152699a-8edf-4692-a589-847c6d4cc5fc tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lazy-loading 'flavor' on Instance uuid 74c5a115-b174-49fe-9b75-574e484a09e2 {{(pid=98153) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Feb 19 05:02:36.133229 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-2565e397-3962-46f1-9f9d-58624b6b5817 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:02:36.194957 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-2565e397-3962-46f1-9f9d-58624b6b5817 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:02:36.201162 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-2565e397-3962-46f1-9f9d-58624b6b5817 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:02:36.213447 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-2565e397-3962-46f1-9f9d-58624b6b5817 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] 10.222.0.47 "GET /compute/v2.1/servers/798b77ff-c3ca-4c65-a120-db12ad953621" status: 200 len: 1741 microversion: 2.20 time: 1.726511 Feb 19 05:02:36.227838 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 214/413] 10.222.0.47 () {60 vars in 1267 bytes} [Fri Feb 19 05:02:34 2021] GET /compute/v2.1/servers/798b77ff-c3ca-4c65-a120-db12ad953621 => generated 1741 bytes in 1746 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 05:02:36.735466 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-45f6f58f-43b2-4ff7-aea2-2804419bb641 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:02:36.738502 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-45f6f58f-43b2-4ff7-aea2-2804419bb641 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] [instance: be65ea57-bc8d-4bce-80c3-33d8b6007ed1] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:02:36.761622 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-45f6f58f-43b2-4ff7-aea2-2804419bb641 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:02:36.762858 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-45f6f58f-43b2-4ff7-aea2-2804419bb641 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:02:36.764679 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-45f6f58f-43b2-4ff7-aea2-2804419bb641 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:02:36.765781 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-45f6f58f-43b2-4ff7-aea2-2804419bb641 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:02:37.453903 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-45f6f58f-43b2-4ff7-aea2-2804419bb641 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3274478c0a421895f43618dc827ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50941a0cab243e9a320ff22a7648de6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:02:37.481421 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-4152699a-8edf-4692-a589-847c6d4cc5fc tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] 10.222.0.47 "POST /compute/v2.1/servers/74c5a115-b174-49fe-9b75-574e484a09e2/action" status: 200 len: 32 microversion: 2.1 time: 1.796725 Feb 19 05:02:37.482550 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 200/414] 10.222.0.47 () {60 vars in 1268 bytes} [Fri Feb 19 05:02:35 2021] POST /compute/v2.1/servers/74c5a115-b174-49fe-9b75-574e484a09e2/action => generated 32 bytes in 1800 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 19 05:02:37.489610 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-6345570b-c555-45b1-bd1f-b6c000abdc60 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:02:37.500821 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-6345570b-c555-45b1-bd1f-b6c000abdc60 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] [instance: 798b77ff-c3ca-4c65-a120-db12ad953621] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:02:37.520909 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-6345570b-c555-45b1-bd1f-b6c000abdc60 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:02:37.521428 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-6345570b-c555-45b1-bd1f-b6c000abdc60 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:02:37.522575 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-6345570b-c555-45b1-bd1f-b6c000abdc60 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:02:37.529192 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-6345570b-c555-45b1-bd1f-b6c000abdc60 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:02:37.537973 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-45f6f58f-43b2-4ff7-aea2-2804419bb641 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] 10.222.0.47 "GET /compute/v2.1/servers/be65ea57-bc8d-4bce-80c3-33d8b6007ed1" status: 200 len: 1721 microversion: 2.1 time: 0.817759 Feb 19 05:02:37.570105 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 215/415] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:02:36 2021] GET /compute/v2.1/servers/be65ea57-bc8d-4bce-80c3-33d8b6007ed1 => generated 1721 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:02:37.600332 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-1af56dc6-319e-4417-b3d7-da949f03d2af tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:02:37.602312 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-1af56dc6-319e-4417-b3d7-da949f03d2af tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] [instance: 74c5a115-b174-49fe-9b75-574e484a09e2] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:02:37.653910 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-1af56dc6-319e-4417-b3d7-da949f03d2af tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:02:37.660420 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-1af56dc6-319e-4417-b3d7-da949f03d2af tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:02:37.666499 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-1af56dc6-319e-4417-b3d7-da949f03d2af tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:02:37.667830 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-1af56dc6-319e-4417-b3d7-da949f03d2af tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:02:39.052170 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-6345570b-c555-45b1-bd1f-b6c000abdc60 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:02:39.093075 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-6345570b-c555-45b1-bd1f-b6c000abdc60 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:02:39.097858 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-6345570b-c555-45b1-bd1f-b6c000abdc60 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:02:39.102509 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-6345570b-c555-45b1-bd1f-b6c000abdc60 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] 10.222.0.47 "GET /compute/v2.1/servers/798b77ff-c3ca-4c65-a120-db12ad953621" status: 200 len: 1741 microversion: 2.20 time: 1.618590 Feb 19 05:02:39.110550 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 201/416] 10.222.0.47 () {60 vars in 1267 bytes} [Fri Feb 19 05:02:37 2021] GET /compute/v2.1/servers/798b77ff-c3ca-4c65-a120-db12ad953621 => generated 1741 bytes in 1627 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 05:02:39.133470 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-7d54b0bd-14c6-4831-8cb8-1a2d5e6c0fd9 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8fa419d8-0012-49d5-81ff-71e4b566984b"}} {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:02:39.141015 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-7d54b0bd-14c6-4831-8cb8-1a2d5e6c0fd9 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] [instance: d49e68e7-1b06-45d5-b811-440fe0435ed4] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:02:39.172245 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-7d54b0bd-14c6-4831-8cb8-1a2d5e6c0fd9 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:02:39.180730 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-7d54b0bd-14c6-4831-8cb8-1a2d5e6c0fd9 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:02:39.182540 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-7d54b0bd-14c6-4831-8cb8-1a2d5e6c0fd9 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:02:39.183770 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-7d54b0bd-14c6-4831-8cb8-1a2d5e6c0fd9 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:02:39.562655 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-1af56dc6-319e-4417-b3d7-da949f03d2af tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24af0562e2aa43ca9d601be5e16fe9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ee9a43087d5497da3af9fbf68c4572d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:02:39.587611 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-1af56dc6-319e-4417-b3d7-da949f03d2af tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] 10.222.0.47 "GET /compute/v2.1/servers/74c5a115-b174-49fe-9b75-574e484a09e2" status: 200 len: 1565 microversion: 2.1 time: 2.015145 Feb 19 05:02:39.608956 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 216/417] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:02:37 2021] GET /compute/v2.1/servers/74c5a115-b174-49fe-9b75-574e484a09e2 => generated 1565 bytes in 2038 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:02:39.622996 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-e548a892-aaa5-4250-94a9-5d3ccc413248 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:02:39.625121 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-e548a892-aaa5-4250-94a9-5d3ccc413248 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] [instance: be65ea57-bc8d-4bce-80c3-33d8b6007ed1] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:02:39.666229 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-e548a892-aaa5-4250-94a9-5d3ccc413248 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:02:39.666229 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-e548a892-aaa5-4250-94a9-5d3ccc413248 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:02:39.666229 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-e548a892-aaa5-4250-94a9-5d3ccc413248 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:02:39.666229 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-e548a892-aaa5-4250-94a9-5d3ccc413248 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:02:40.294323 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-7d54b0bd-14c6-4831-8cb8-1a2d5e6c0fd9 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] 10.222.0.47 "POST /compute/v2.1/servers/d49e68e7-1b06-45d5-b811-440fe0435ed4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.180200 Feb 19 05:02:40.311837 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 202/418] 10.222.0.47 () {60 vars in 1313 bytes} [Fri Feb 19 05:02:39 2021] POST /compute/v2.1/servers/d49e68e7-1b06-45d5-b811-440fe0435ed4/os-volume_attachments => generated 194 bytes in 1200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 05:02:40.327920 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-6ec59888-6b83-430f-be10-a28c1f26fe4f tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "59b74bfb-ca28-4986-a8e7-eed98d56db9f", "device": "/dev/sdb"}} {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:02:40.330165 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-6ec59888-6b83-430f-be10-a28c1f26fe4f tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] [instance: 0d55dde2-c4d7-4da3-9f14-2e6a30f69bcb] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:02:40.393961 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-6ec59888-6b83-430f-be10-a28c1f26fe4f tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:02:40.395961 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-6ec59888-6b83-430f-be10-a28c1f26fe4f tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:02:40.397166 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-6ec59888-6b83-430f-be10-a28c1f26fe4f tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:02:40.397848 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-6ec59888-6b83-430f-be10-a28c1f26fe4f tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:02:41.092975 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-e548a892-aaa5-4250-94a9-5d3ccc413248 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3274478c0a421895f43618dc827ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50941a0cab243e9a320ff22a7648de6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:02:41.114246 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-e548a892-aaa5-4250-94a9-5d3ccc413248 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] 10.222.0.47 "GET /compute/v2.1/servers/be65ea57-bc8d-4bce-80c3-33d8b6007ed1" status: 200 len: 1721 microversion: 2.1 time: 1.503530 Feb 19 05:02:41.117226 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 217/419] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:02:39 2021] GET /compute/v2.1/servers/be65ea57-bc8d-4bce-80c3-33d8b6007ed1 => generated 1721 bytes in 1507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:02:41.134235 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-b37c51ac-d360-42c4-9445-8e1957636b34 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:02:41.135649 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-b37c51ac-d360-42c4-9445-8e1957636b34 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] [instance: 798b77ff-c3ca-4c65-a120-db12ad953621] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:02:41.155313 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-b37c51ac-d360-42c4-9445-8e1957636b34 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:02:41.156198 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-b37c51ac-d360-42c4-9445-8e1957636b34 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:02:41.157323 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-b37c51ac-d360-42c4-9445-8e1957636b34 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:02:41.163766 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-b37c51ac-d360-42c4-9445-8e1957636b34 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:02:41.652786 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-b37c51ac-d360-42c4-9445-8e1957636b34 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:02:41.676737 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-b37c51ac-d360-42c4-9445-8e1957636b34 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:02:41.680739 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-b37c51ac-d360-42c4-9445-8e1957636b34 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:02:41.682961 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-b37c51ac-d360-42c4-9445-8e1957636b34 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] 10.222.0.47 "GET /compute/v2.1/servers/798b77ff-c3ca-4c65-a120-db12ad953621" status: 200 len: 1741 microversion: 2.20 time: 0.564188 Feb 19 05:02:41.684065 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 218/420] 10.222.0.47 () {60 vars in 1267 bytes} [Fri Feb 19 05:02:41 2021] GET /compute/v2.1/servers/798b77ff-c3ca-4c65-a120-db12ad953621 => generated 1741 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 05:02:41.694840 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-cb5ac7a5-3928-4db9-ad4b-48c85a4aecba tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:02:41.696724 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-cb5ac7a5-3928-4db9-ad4b-48c85a4aecba tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] [instance: 74c5a115-b174-49fe-9b75-574e484a09e2] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:02:41.714157 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-cb5ac7a5-3928-4db9-ad4b-48c85a4aecba tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:02:41.715698 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-cb5ac7a5-3928-4db9-ad4b-48c85a4aecba tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:02:41.717978 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-cb5ac7a5-3928-4db9-ad4b-48c85a4aecba tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:02:41.719187 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-cb5ac7a5-3928-4db9-ad4b-48c85a4aecba tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:02:41.721811 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-6ec59888-6b83-430f-be10-a28c1f26fe4f tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] 10.222.0.47 "POST /compute/v2.1/servers/0d55dde2-c4d7-4da3-9f14-2e6a30f69bcb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.404332 Feb 19 05:02:41.729470 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 203/421] 10.222.0.47 () {60 vars in 1313 bytes} [Fri Feb 19 05:02:40 2021] POST /compute/v2.1/servers/0d55dde2-c4d7-4da3-9f14-2e6a30f69bcb/os-volume_attachments => generated 194 bytes in 1417 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 05:02:42.141326 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-fd255cc8-a767-4e72-ad8b-a251f20615b4 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:02:42.145094 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-fd255cc8-a767-4e72-ad8b-a251f20615b4 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] [instance: be65ea57-bc8d-4bce-80c3-33d8b6007ed1] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:02:42.165660 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-fd255cc8-a767-4e72-ad8b-a251f20615b4 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:02:42.168224 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-fd255cc8-a767-4e72-ad8b-a251f20615b4 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:02:42.178963 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-fd255cc8-a767-4e72-ad8b-a251f20615b4 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:02:42.179924 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-fd255cc8-a767-4e72-ad8b-a251f20615b4 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:02:42.273947 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-cb5ac7a5-3928-4db9-ad4b-48c85a4aecba tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24af0562e2aa43ca9d601be5e16fe9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ee9a43087d5497da3af9fbf68c4572d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:02:42.290374 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-cb5ac7a5-3928-4db9-ad4b-48c85a4aecba tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] 10.222.0.47 "GET /compute/v2.1/servers/74c5a115-b174-49fe-9b75-574e484a09e2" status: 200 len: 1565 microversion: 2.1 time: 0.604217 Feb 19 05:02:42.295685 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 219/422] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:02:41 2021] GET /compute/v2.1/servers/74c5a115-b174-49fe-9b75-574e484a09e2 => generated 1565 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:02:42.711372 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-3b9061ac-7539-4185-be55-da3a3b07949d tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:02:42.728430 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-3b9061ac-7539-4185-be55-da3a3b07949d tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] [instance: 798b77ff-c3ca-4c65-a120-db12ad953621] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:02:42.755862 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-3b9061ac-7539-4185-be55-da3a3b07949d tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:02:42.773818 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-3b9061ac-7539-4185-be55-da3a3b07949d tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:02:42.776338 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-3b9061ac-7539-4185-be55-da3a3b07949d tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:02:42.781291 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-3b9061ac-7539-4185-be55-da3a3b07949d tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:02:42.804690 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-fd255cc8-a767-4e72-ad8b-a251f20615b4 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3274478c0a421895f43618dc827ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50941a0cab243e9a320ff22a7648de6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:02:42.822845 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-fd255cc8-a767-4e72-ad8b-a251f20615b4 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] 10.222.0.47 "GET /compute/v2.1/servers/be65ea57-bc8d-4bce-80c3-33d8b6007ed1" status: 200 len: 1721 microversion: 2.1 time: 0.686061 Feb 19 05:02:42.826347 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 204/423] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:02:42 2021] GET /compute/v2.1/servers/be65ea57-bc8d-4bce-80c3-33d8b6007ed1 => generated 1721 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 05:02:43.311181 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-7dbca9dc-4ab7-4827-9df7-47bd70d7a978 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:02:43.312180 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-7dbca9dc-4ab7-4827-9df7-47bd70d7a978 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] [instance: 74c5a115-b174-49fe-9b75-574e484a09e2] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:02:43.335874 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-7dbca9dc-4ab7-4827-9df7-47bd70d7a978 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:02:43.337837 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-7dbca9dc-4ab7-4827-9df7-47bd70d7a978 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:02:43.340287 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-7dbca9dc-4ab7-4827-9df7-47bd70d7a978 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:02:43.340954 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-7dbca9dc-4ab7-4827-9df7-47bd70d7a978 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:02:43.475585 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-3b9061ac-7539-4185-be55-da3a3b07949d tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:02:43.507941 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-3b9061ac-7539-4185-be55-da3a3b07949d tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:02:43.513266 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-3b9061ac-7539-4185-be55-da3a3b07949d tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:02:43.527208 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-3b9061ac-7539-4185-be55-da3a3b07949d tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] 10.222.0.47 "GET /compute/v2.1/servers/798b77ff-c3ca-4c65-a120-db12ad953621" status: 200 len: 1741 microversion: 2.20 time: 0.818355 Feb 19 05:02:43.528300 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 220/424] 10.222.0.47 () {60 vars in 1267 bytes} [Fri Feb 19 05:02:42 2021] GET /compute/v2.1/servers/798b77ff-c3ca-4c65-a120-db12ad953621 => generated 1741 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 05:02:43.835194 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-7dbca9dc-4ab7-4827-9df7-47bd70d7a978 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24af0562e2aa43ca9d601be5e16fe9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ee9a43087d5497da3af9fbf68c4572d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:02:43.848310 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-1fea9c58-059c-4c66-9f78-f134c2fc44cf tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:02:43.849366 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-1fea9c58-059c-4c66-9f78-f134c2fc44cf tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] [instance: be65ea57-bc8d-4bce-80c3-33d8b6007ed1] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:02:43.859593 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-1fea9c58-059c-4c66-9f78-f134c2fc44cf tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:02:43.860470 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-1fea9c58-059c-4c66-9f78-f134c2fc44cf tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:02:43.861661 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-1fea9c58-059c-4c66-9f78-f134c2fc44cf tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:02:43.862855 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-1fea9c58-059c-4c66-9f78-f134c2fc44cf tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:02:43.865725 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-7dbca9dc-4ab7-4827-9df7-47bd70d7a978 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] 10.222.0.47 "GET /compute/v2.1/servers/74c5a115-b174-49fe-9b75-574e484a09e2" status: 200 len: 1565 microversion: 2.1 time: 0.541366 Feb 19 05:02:43.870023 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 205/425] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:02:43 2021] GET /compute/v2.1/servers/74c5a115-b174-49fe-9b75-574e484a09e2 => generated 1565 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:02:44.321401 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-1fea9c58-059c-4c66-9f78-f134c2fc44cf tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3274478c0a421895f43618dc827ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50941a0cab243e9a320ff22a7648de6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:02:44.335292 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-1fea9c58-059c-4c66-9f78-f134c2fc44cf tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] 10.222.0.47 "GET /compute/v2.1/servers/be65ea57-bc8d-4bce-80c3-33d8b6007ed1" status: 200 len: 1721 microversion: 2.1 time: 0.491799 Feb 19 05:02:44.336519 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 221/426] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:02:43 2021] GET /compute/v2.1/servers/be65ea57-bc8d-4bce-80c3-33d8b6007ed1 => generated 1721 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:02:44.561312 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-ff9f29c6-45d4-4e75-afdf-07278948eced tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:02:44.571723 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-ff9f29c6-45d4-4e75-afdf-07278948eced tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] [instance: 798b77ff-c3ca-4c65-a120-db12ad953621] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:02:44.605454 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-ff9f29c6-45d4-4e75-afdf-07278948eced tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:02:44.613379 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-ff9f29c6-45d4-4e75-afdf-07278948eced tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:02:44.625338 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-ff9f29c6-45d4-4e75-afdf-07278948eced tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:02:44.628764 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-ff9f29c6-45d4-4e75-afdf-07278948eced tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:02:44.888709 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-f8ac1a53-c8aa-44a9-af79-5a314be3a767 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:02:44.889708 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-f8ac1a53-c8aa-44a9-af79-5a314be3a767 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] [instance: 74c5a115-b174-49fe-9b75-574e484a09e2] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:02:44.909615 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-f8ac1a53-c8aa-44a9-af79-5a314be3a767 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:02:44.910154 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-f8ac1a53-c8aa-44a9-af79-5a314be3a767 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:02:44.911132 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-f8ac1a53-c8aa-44a9-af79-5a314be3a767 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:02:44.911472 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-f8ac1a53-c8aa-44a9-af79-5a314be3a767 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:02:45.467166 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-ff9f29c6-45d4-4e75-afdf-07278948eced tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:02:45.532563 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-ff9f29c6-45d4-4e75-afdf-07278948eced tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:02:45.536369 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-ff9f29c6-45d4-4e75-afdf-07278948eced tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:02:45.542683 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-ff9f29c6-45d4-4e75-afdf-07278948eced tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] 10.222.0.47 "GET /compute/v2.1/servers/798b77ff-c3ca-4c65-a120-db12ad953621" status: 200 len: 1741 microversion: 2.20 time: 0.995636 Feb 19 05:02:45.559627 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 206/427] 10.222.0.47 () {60 vars in 1267 bytes} [Fri Feb 19 05:02:44 2021] GET /compute/v2.1/servers/798b77ff-c3ca-4c65-a120-db12ad953621 => generated 1741 bytes in 1014 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 05:02:45.574648 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-b8b74467-d504-46c1-8a4e-65e36dbd1444 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:02:45.576023 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-b8b74467-d504-46c1-8a4e-65e36dbd1444 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] [instance: be65ea57-bc8d-4bce-80c3-33d8b6007ed1] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:02:45.612430 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-b8b74467-d504-46c1-8a4e-65e36dbd1444 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:02:45.613919 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-b8b74467-d504-46c1-8a4e-65e36dbd1444 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:02:45.619625 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-b8b74467-d504-46c1-8a4e-65e36dbd1444 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:02:45.622901 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-b8b74467-d504-46c1-8a4e-65e36dbd1444 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:02:45.734194 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-f8ac1a53-c8aa-44a9-af79-5a314be3a767 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24af0562e2aa43ca9d601be5e16fe9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ee9a43087d5497da3af9fbf68c4572d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:02:45.755659 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-f8ac1a53-c8aa-44a9-af79-5a314be3a767 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] 10.222.0.47 "GET /compute/v2.1/servers/74c5a115-b174-49fe-9b75-574e484a09e2" status: 200 len: 1565 microversion: 2.1 time: 0.871296 Feb 19 05:02:45.763690 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 222/428] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:02:44 2021] GET /compute/v2.1/servers/74c5a115-b174-49fe-9b75-574e484a09e2 => generated 1565 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 05:02:46.310521 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-b8b74467-d504-46c1-8a4e-65e36dbd1444 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3274478c0a421895f43618dc827ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50941a0cab243e9a320ff22a7648de6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:02:46.340077 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-b8b74467-d504-46c1-8a4e-65e36dbd1444 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] 10.222.0.47 "GET /compute/v2.1/servers/be65ea57-bc8d-4bce-80c3-33d8b6007ed1" status: 200 len: 1698 microversion: 2.1 time: 0.770751 Feb 19 05:02:46.347897 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 207/429] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:02:45 2021] GET /compute/v2.1/servers/be65ea57-bc8d-4bce-80c3-33d8b6007ed1 => generated 1698 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:02:46.359954 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-850ec4dc-6eaa-4076-bdc1-9598ac7da187 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:02:46.386790 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-850ec4dc-6eaa-4076-bdc1-9598ac7da187 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:02:46.392269 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-850ec4dc-6eaa-4076-bdc1-9598ac7da187 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:02:46.553276 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-850ec4dc-6eaa-4076-bdc1-9598ac7da187 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] [instance: be65ea57-bc8d-4bce-80c3-33d8b6007ed1] Going to try to start instance {{(pid=98154) start /opt/stack/nova/nova/compute/api.py:2603}} Feb 19 05:02:46.569102 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-ebd4795e-1adf-4baa-8bb7-3119db471f62 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:02:46.570738 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-ebd4795e-1adf-4baa-8bb7-3119db471f62 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] [instance: 798b77ff-c3ca-4c65-a120-db12ad953621] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:02:46.604865 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-ebd4795e-1adf-4baa-8bb7-3119db471f62 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:02:46.605947 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-ebd4795e-1adf-4baa-8bb7-3119db471f62 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:02:46.607251 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-ebd4795e-1adf-4baa-8bb7-3119db471f62 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:02:46.608080 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-ebd4795e-1adf-4baa-8bb7-3119db471f62 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:02:46.897411 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-850ec4dc-6eaa-4076-bdc1-9598ac7da187 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] 10.222.0.47 "POST /compute/v2.1/servers/be65ea57-bc8d-4bce-80c3-33d8b6007ed1/action" status: 202 len: 0 microversion: 2.1 time: 0.541323 Feb 19 05:02:46.904840 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 223/430] 10.222.0.47 () {60 vars in 1268 bytes} [Fri Feb 19 05:02:46 2021] POST /compute/v2.1/servers/be65ea57-bc8d-4bce-80c3-33d8b6007ed1/action => generated 0 bytes in 550 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 19 05:02:46.911485 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-b32840df-bbf4-44f7-b12b-d9e13987a676 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:02:46.927987 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-b32840df-bbf4-44f7-b12b-d9e13987a676 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] [instance: 74c5a115-b174-49fe-9b75-574e484a09e2] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:02:46.970635 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-b32840df-bbf4-44f7-b12b-d9e13987a676 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:02:46.974649 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-b32840df-bbf4-44f7-b12b-d9e13987a676 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:02:46.980064 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-b32840df-bbf4-44f7-b12b-d9e13987a676 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:02:46.983121 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-b32840df-bbf4-44f7-b12b-d9e13987a676 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:02:47.351131 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-ebd4795e-1adf-4baa-8bb7-3119db471f62 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:02:47.381279 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-ebd4795e-1adf-4baa-8bb7-3119db471f62 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:02:47.384593 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-ebd4795e-1adf-4baa-8bb7-3119db471f62 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:02:47.387001 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-ebd4795e-1adf-4baa-8bb7-3119db471f62 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] 10.222.0.47 "GET /compute/v2.1/servers/798b77ff-c3ca-4c65-a120-db12ad953621" status: 200 len: 1741 microversion: 2.20 time: 0.823858 Feb 19 05:02:47.387902 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 208/431] 10.222.0.47 () {60 vars in 1267 bytes} [Fri Feb 19 05:02:46 2021] GET /compute/v2.1/servers/798b77ff-c3ca-4c65-a120-db12ad953621 => generated 1741 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 05:02:47.394339 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-eb495461-1bbd-4a7c-bd65-f103536787c0 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:02:47.395279 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-eb495461-1bbd-4a7c-bd65-f103536787c0 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] [instance: be65ea57-bc8d-4bce-80c3-33d8b6007ed1] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:02:47.406581 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-eb495461-1bbd-4a7c-bd65-f103536787c0 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:02:47.407406 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-eb495461-1bbd-4a7c-bd65-f103536787c0 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:02:47.408517 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-eb495461-1bbd-4a7c-bd65-f103536787c0 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:02:47.409136 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-eb495461-1bbd-4a7c-bd65-f103536787c0 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:02:48.072841 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-b32840df-bbf4-44f7-b12b-d9e13987a676 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24af0562e2aa43ca9d601be5e16fe9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ee9a43087d5497da3af9fbf68c4572d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:02:48.084908 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-b32840df-bbf4-44f7-b12b-d9e13987a676 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] 10.222.0.47 "GET /compute/v2.1/servers/74c5a115-b174-49fe-9b75-574e484a09e2" status: 200 len: 1565 microversion: 2.1 time: 1.178198 Feb 19 05:02:48.085866 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 224/432] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:02:46 2021] GET /compute/v2.1/servers/74c5a115-b174-49fe-9b75-574e484a09e2 => generated 1565 bytes in 1180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:02:48.201693 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-eb495461-1bbd-4a7c-bd65-f103536787c0 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3274478c0a421895f43618dc827ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50941a0cab243e9a320ff22a7648de6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:02:48.242328 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-eb495461-1bbd-4a7c-bd65-f103536787c0 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] 10.222.0.47 "GET /compute/v2.1/servers/be65ea57-bc8d-4bce-80c3-33d8b6007ed1" status: 200 len: 1707 microversion: 2.1 time: 0.852589 Feb 19 05:02:48.247709 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 209/433] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:02:47 2021] GET /compute/v2.1/servers/be65ea57-bc8d-4bce-80c3-33d8b6007ed1 => generated 1707 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:02:48.448384 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-380bdd2b-fab4-424e-85f0-0f22a8ce6863 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:02:48.457151 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-380bdd2b-fab4-424e-85f0-0f22a8ce6863 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] [instance: 798b77ff-c3ca-4c65-a120-db12ad953621] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:02:48.522444 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-380bdd2b-fab4-424e-85f0-0f22a8ce6863 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:02:48.528341 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-380bdd2b-fab4-424e-85f0-0f22a8ce6863 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:02:48.530146 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-380bdd2b-fab4-424e-85f0-0f22a8ce6863 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:02:48.555290 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-380bdd2b-fab4-424e-85f0-0f22a8ce6863 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:02:49.130915 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-f32103c9-9b9b-4cc2-ae70-3dd0f8f6458a tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:02:49.145016 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-f32103c9-9b9b-4cc2-ae70-3dd0f8f6458a tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] [instance: 74c5a115-b174-49fe-9b75-574e484a09e2] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:02:49.193839 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-f32103c9-9b9b-4cc2-ae70-3dd0f8f6458a tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:02:49.211629 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-f32103c9-9b9b-4cc2-ae70-3dd0f8f6458a tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:02:49.213503 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-f32103c9-9b9b-4cc2-ae70-3dd0f8f6458a tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:02:49.214458 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-f32103c9-9b9b-4cc2-ae70-3dd0f8f6458a tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:02:51.121395 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-380bdd2b-fab4-424e-85f0-0f22a8ce6863 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:02:51.139979 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-380bdd2b-fab4-424e-85f0-0f22a8ce6863 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:02:51.148977 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-380bdd2b-fab4-424e-85f0-0f22a8ce6863 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:02:51.150719 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-380bdd2b-fab4-424e-85f0-0f22a8ce6863 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] 10.222.0.47 "GET /compute/v2.1/servers/798b77ff-c3ca-4c65-a120-db12ad953621" status: 200 len: 1741 microversion: 2.20 time: 2.724390 Feb 19 05:02:51.151736 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 225/434] 10.222.0.47 () {60 vars in 1267 bytes} [Fri Feb 19 05:02:48 2021] GET /compute/v2.1/servers/798b77ff-c3ca-4c65-a120-db12ad953621 => generated 1741 bytes in 2728 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 05:02:51.167652 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-69fbc379-455c-4545-9175-292d12eadcce tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:02:51.174228 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-69fbc379-455c-4545-9175-292d12eadcce tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] [instance: be65ea57-bc8d-4bce-80c3-33d8b6007ed1] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:02:51.197105 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-69fbc379-455c-4545-9175-292d12eadcce tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:02:51.198304 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-69fbc379-455c-4545-9175-292d12eadcce tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:02:51.202534 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-69fbc379-455c-4545-9175-292d12eadcce tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:02:51.203417 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-69fbc379-455c-4545-9175-292d12eadcce tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:02:51.476400 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-f32103c9-9b9b-4cc2-ae70-3dd0f8f6458a tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24af0562e2aa43ca9d601be5e16fe9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ee9a43087d5497da3af9fbf68c4572d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:02:51.492445 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-f32103c9-9b9b-4cc2-ae70-3dd0f8f6458a tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] 10.222.0.47 "GET /compute/v2.1/servers/74c5a115-b174-49fe-9b75-574e484a09e2" status: 200 len: 1565 microversion: 2.1 time: 2.377905 Feb 19 05:02:51.514561 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 210/435] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:02:49 2021] GET /compute/v2.1/servers/74c5a115-b174-49fe-9b75-574e484a09e2 => generated 1565 bytes in 2401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:02:51.524055 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-fb2a612c-9da9-46c6-bec8-f32060459eb2 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:02:51.524979 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-fb2a612c-9da9-46c6-bec8-f32060459eb2 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] [instance: d49e68e7-1b06-45d5-b811-440fe0435ed4] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:02:51.556350 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-fb2a612c-9da9-46c6-bec8-f32060459eb2 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:02:51.557315 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-fb2a612c-9da9-46c6-bec8-f32060459eb2 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:02:51.561696 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-fb2a612c-9da9-46c6-bec8-f32060459eb2 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:02:51.565825 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-fb2a612c-9da9-46c6-bec8-f32060459eb2 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:02:52.226998 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-69fbc379-455c-4545-9175-292d12eadcce tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3274478c0a421895f43618dc827ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50941a0cab243e9a320ff22a7648de6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:02:52.254122 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-69fbc379-455c-4545-9175-292d12eadcce tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] 10.222.0.47 "GET /compute/v2.1/servers/be65ea57-bc8d-4bce-80c3-33d8b6007ed1" status: 200 len: 1707 microversion: 2.1 time: 1.095049 Feb 19 05:02:52.254855 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 226/436] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:02:51 2021] GET /compute/v2.1/servers/be65ea57-bc8d-4bce-80c3-33d8b6007ed1 => generated 1707 bytes in 1102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:02:52.308413 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-7d6c596f-8b0e-491e-a9dd-f7e5c106e655 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:02:52.310945 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-7d6c596f-8b0e-491e-a9dd-f7e5c106e655 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] [instance: 798b77ff-c3ca-4c65-a120-db12ad953621] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:02:52.363171 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-7d6c596f-8b0e-491e-a9dd-f7e5c106e655 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:02:52.365378 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-7d6c596f-8b0e-491e-a9dd-f7e5c106e655 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:02:52.366905 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-7d6c596f-8b0e-491e-a9dd-f7e5c106e655 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:02:52.371941 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-7d6c596f-8b0e-491e-a9dd-f7e5c106e655 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:02:52.717907 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.objects.instance [None req-fb2a612c-9da9-46c6-bec8-f32060459eb2 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lazy-loading 'services' on Instance uuid d49e68e7-1b06-45d5-b811-440fe0435ed4 {{(pid=98153) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Feb 19 05:02:53.039537 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-7d6c596f-8b0e-491e-a9dd-f7e5c106e655 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:02:53.057876 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-7d6c596f-8b0e-491e-a9dd-f7e5c106e655 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:02:53.060656 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-7d6c596f-8b0e-491e-a9dd-f7e5c106e655 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:02:53.062398 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-7d6c596f-8b0e-491e-a9dd-f7e5c106e655 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] 10.222.0.47 "GET /compute/v2.1/servers/798b77ff-c3ca-4c65-a120-db12ad953621" status: 200 len: 1741 microversion: 2.20 time: 0.786986 Feb 19 05:02:53.063258 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 227/437] 10.222.0.47 () {60 vars in 1267 bytes} [Fri Feb 19 05:02:52 2021] GET /compute/v2.1/servers/798b77ff-c3ca-4c65-a120-db12ad953621 => generated 1741 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 05:02:53.073821 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-1e723ad5-5c49-4b8f-af0d-5463c4dd1824 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:02:53.075535 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-1e723ad5-5c49-4b8f-af0d-5463c4dd1824 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] [instance: 74c5a115-b174-49fe-9b75-574e484a09e2] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:02:53.092575 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-1e723ad5-5c49-4b8f-af0d-5463c4dd1824 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:02:53.093487 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-1e723ad5-5c49-4b8f-af0d-5463c4dd1824 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:02:53.094935 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-1e723ad5-5c49-4b8f-af0d-5463c4dd1824 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:02:53.096051 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-1e723ad5-5c49-4b8f-af0d-5463c4dd1824 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:02:53.260974 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-fb2a612c-9da9-46c6-bec8-f32060459eb2 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] 10.222.0.47 "DELETE /compute/v2.1/servers/d49e68e7-1b06-45d5-b811-440fe0435ed4/os-volume_attachments/8fa419d8-0012-49d5-81ff-71e4b566984b" status: 202 len: 0 microversion: 2.1 time: 1.735559 Feb 19 05:02:53.273312 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 211/438] 10.222.0.47 () {58 vars in 1406 bytes} [Fri Feb 19 05:02:51 2021] DELETE /compute/v2.1/servers/d49e68e7-1b06-45d5-b811-440fe0435ed4/os-volume_attachments/8fa419d8-0012-49d5-81ff-71e4b566984b => generated 0 bytes in 1751 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 19 05:02:53.285124 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-41aae591-ff05-4231-85dd-3a44b6320474 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:02:53.286186 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-41aae591-ff05-4231-85dd-3a44b6320474 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] [instance: be65ea57-bc8d-4bce-80c3-33d8b6007ed1] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:02:53.297539 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-41aae591-ff05-4231-85dd-3a44b6320474 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:02:53.298538 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-41aae591-ff05-4231-85dd-3a44b6320474 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:02:53.300054 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-41aae591-ff05-4231-85dd-3a44b6320474 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:02:53.300719 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-41aae591-ff05-4231-85dd-3a44b6320474 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:02:53.787852 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-41aae591-ff05-4231-85dd-3a44b6320474 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3274478c0a421895f43618dc827ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50941a0cab243e9a320ff22a7648de6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:02:53.805909 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-41aae591-ff05-4231-85dd-3a44b6320474 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] 10.222.0.47 "GET /compute/v2.1/servers/be65ea57-bc8d-4bce-80c3-33d8b6007ed1" status: 200 len: 1707 microversion: 2.1 time: 0.529294 Feb 19 05:02:53.830620 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 212/439] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:02:53 2021] GET /compute/v2.1/servers/be65ea57-bc8d-4bce-80c3-33d8b6007ed1 => generated 1707 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:02:54.067665 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-1e723ad5-5c49-4b8f-af0d-5463c4dd1824 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24af0562e2aa43ca9d601be5e16fe9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ee9a43087d5497da3af9fbf68c4572d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:02:54.084756 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-22551a23-eb48-4910-a93a-af5862171b29 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:02:54.085444 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-22551a23-eb48-4910-a93a-af5862171b29 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] [instance: 798b77ff-c3ca-4c65-a120-db12ad953621] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:02:54.115859 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-1e723ad5-5c49-4b8f-af0d-5463c4dd1824 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] 10.222.0.47 "GET /compute/v2.1/servers/74c5a115-b174-49fe-9b75-574e484a09e2" status: 200 len: 1565 microversion: 2.1 time: 1.039204 Feb 19 05:02:54.117504 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 228/440] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:02:53 2021] GET /compute/v2.1/servers/74c5a115-b174-49fe-9b75-574e484a09e2 => generated 1565 bytes in 1053 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:02:54.126971 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-22551a23-eb48-4910-a93a-af5862171b29 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:02:54.135653 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-22551a23-eb48-4910-a93a-af5862171b29 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:02:54.136683 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-22551a23-eb48-4910-a93a-af5862171b29 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:02:54.138533 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-22551a23-eb48-4910-a93a-af5862171b29 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:02:54.825548 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-93982e5c-7e93-4f3b-bc48-2edbf1bb5800 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:02:54.827921 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-93982e5c-7e93-4f3b-bc48-2edbf1bb5800 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] [instance: be65ea57-bc8d-4bce-80c3-33d8b6007ed1] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:02:54.861631 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-93982e5c-7e93-4f3b-bc48-2edbf1bb5800 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:02:54.864676 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-93982e5c-7e93-4f3b-bc48-2edbf1bb5800 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:02:54.868042 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-93982e5c-7e93-4f3b-bc48-2edbf1bb5800 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:02:54.868838 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-93982e5c-7e93-4f3b-bc48-2edbf1bb5800 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:02:55.101015 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-22551a23-eb48-4910-a93a-af5862171b29 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:02:55.185219 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-22551a23-eb48-4910-a93a-af5862171b29 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:02:55.201832 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-22551a23-eb48-4910-a93a-af5862171b29 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:02:55.213399 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-22551a23-eb48-4910-a93a-af5862171b29 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] 10.222.0.47 "GET /compute/v2.1/servers/798b77ff-c3ca-4c65-a120-db12ad953621" status: 200 len: 1741 microversion: 2.20 time: 1.133742 Feb 19 05:02:55.246487 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 213/441] 10.222.0.47 () {60 vars in 1267 bytes} [Fri Feb 19 05:02:54 2021] GET /compute/v2.1/servers/798b77ff-c3ca-4c65-a120-db12ad953621 => generated 1741 bytes in 1165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 05:02:55.272554 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-b9a02e5a-24fc-43f6-ba82-9121d846871d tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:02:55.273444 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-b9a02e5a-24fc-43f6-ba82-9121d846871d tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] [instance: 74c5a115-b174-49fe-9b75-574e484a09e2] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:02:55.289143 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-b9a02e5a-24fc-43f6-ba82-9121d846871d tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:02:55.291904 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-b9a02e5a-24fc-43f6-ba82-9121d846871d tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:02:55.293027 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-b9a02e5a-24fc-43f6-ba82-9121d846871d tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:02:55.295056 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-b9a02e5a-24fc-43f6-ba82-9121d846871d tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:02:56.452834 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-b9a02e5a-24fc-43f6-ba82-9121d846871d tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24af0562e2aa43ca9d601be5e16fe9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ee9a43087d5497da3af9fbf68c4572d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:02:56.510304 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-b9a02e5a-24fc-43f6-ba82-9121d846871d tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] 10.222.0.47 "GET /compute/v2.1/servers/74c5a115-b174-49fe-9b75-574e484a09e2" status: 200 len: 1565 microversion: 2.1 time: 1.260815 Feb 19 05:02:56.523662 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 214/442] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:02:55 2021] GET /compute/v2.1/servers/74c5a115-b174-49fe-9b75-574e484a09e2 => generated 1565 bytes in 1277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:02:56.556069 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-e49425d4-ce6e-454d-9fea-0f7d36742c22 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:02:56.560655 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-e49425d4-ce6e-454d-9fea-0f7d36742c22 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] [instance: 798b77ff-c3ca-4c65-a120-db12ad953621] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:02:56.590759 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-e49425d4-ce6e-454d-9fea-0f7d36742c22 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:02:56.597094 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-e49425d4-ce6e-454d-9fea-0f7d36742c22 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:02:56.605803 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-e49425d4-ce6e-454d-9fea-0f7d36742c22 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:02:56.609937 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-e49425d4-ce6e-454d-9fea-0f7d36742c22 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:02:56.691250 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-93982e5c-7e93-4f3b-bc48-2edbf1bb5800 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3274478c0a421895f43618dc827ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50941a0cab243e9a320ff22a7648de6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:02:56.725505 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-93982e5c-7e93-4f3b-bc48-2edbf1bb5800 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] 10.222.0.47 "GET /compute/v2.1/servers/be65ea57-bc8d-4bce-80c3-33d8b6007ed1" status: 200 len: 1711 microversion: 2.1 time: 1.904188 Feb 19 05:02:56.739491 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 229/443] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:02:54 2021] GET /compute/v2.1/servers/be65ea57-bc8d-4bce-80c3-33d8b6007ed1 => generated 1711 bytes in 1919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 05:02:57.567801 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-4dc3916c-bdfd-4e4b-a010-9a9cd2dc4d8d tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:02:57.570233 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-4dc3916c-bdfd-4e4b-a010-9a9cd2dc4d8d tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] [instance: 74c5a115-b174-49fe-9b75-574e484a09e2] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:02:57.605110 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-4dc3916c-bdfd-4e4b-a010-9a9cd2dc4d8d tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:02:57.609444 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-4dc3916c-bdfd-4e4b-a010-9a9cd2dc4d8d tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:02:57.611292 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-4dc3916c-bdfd-4e4b-a010-9a9cd2dc4d8d tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:02:57.619445 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-4dc3916c-bdfd-4e4b-a010-9a9cd2dc4d8d tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:02:57.743732 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 19 05:02:57.744048 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: Fri Feb 19 05:02:57 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/74c5a115-b174-49fe-9b75-574e484a09e2 (ip 10.222.0.47) !!! Feb 19 05:02:57.912012 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-e49425d4-ce6e-454d-9fea-0f7d36742c22 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:02:57.999925 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-e49425d4-ce6e-454d-9fea-0f7d36742c22 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:02:58.003536 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-e49425d4-ce6e-454d-9fea-0f7d36742c22 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:02:58.010695 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-e49425d4-ce6e-454d-9fea-0f7d36742c22 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] 10.222.0.47 "GET /compute/v2.1/servers/798b77ff-c3ca-4c65-a120-db12ad953621" status: 200 len: 1741 microversion: 2.20 time: 1.483506 Feb 19 05:02:58.011558 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 215/444] 10.222.0.47 () {60 vars in 1267 bytes} [Fri Feb 19 05:02:56 2021] GET /compute/v2.1/servers/798b77ff-c3ca-4c65-a120-db12ad953621 => generated 1741 bytes in 1486 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 05:02:58.418064 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-4dc3916c-bdfd-4e4b-a010-9a9cd2dc4d8d tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24af0562e2aa43ca9d601be5e16fe9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ee9a43087d5497da3af9fbf68c4572d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:02:58.435919 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-4dc3916c-bdfd-4e4b-a010-9a9cd2dc4d8d tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] 10.222.0.47 "GET /compute/v2.1/servers/74c5a115-b174-49fe-9b75-574e484a09e2" status: 200 len: 1565 microversion: 2.1 time: 0.880349 Feb 19 05:02:58.437201 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 230/445] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:02:57 2021] GET /compute/v2.1/servers/74c5a115-b174-49fe-9b75-574e484a09e2 => generated 1565 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:02:59.041679 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-bdcf8542-6a05-42df-b4a0-610a23d55647 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:02:59.043626 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-bdcf8542-6a05-42df-b4a0-610a23d55647 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] [instance: 798b77ff-c3ca-4c65-a120-db12ad953621] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:02:59.074031 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-bdcf8542-6a05-42df-b4a0-610a23d55647 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:02:59.081276 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-bdcf8542-6a05-42df-b4a0-610a23d55647 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:02:59.083012 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-bdcf8542-6a05-42df-b4a0-610a23d55647 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:02:59.084084 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-bdcf8542-6a05-42df-b4a0-610a23d55647 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:02:59.387766 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-bdcf8542-6a05-42df-b4a0-610a23d55647 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:02:59.401858 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-bdcf8542-6a05-42df-b4a0-610a23d55647 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:02:59.404649 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-bdcf8542-6a05-42df-b4a0-610a23d55647 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:02:59.407199 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-bdcf8542-6a05-42df-b4a0-610a23d55647 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] 10.222.0.47 "GET /compute/v2.1/servers/798b77ff-c3ca-4c65-a120-db12ad953621" status: 200 len: 1741 microversion: 2.20 time: 0.374706 Feb 19 05:02:59.408301 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 216/446] 10.222.0.47 () {60 vars in 1267 bytes} [Fri Feb 19 05:02:59 2021] GET /compute/v2.1/servers/798b77ff-c3ca-4c65-a120-db12ad953621 => generated 1741 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 05:02:59.468510 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-e2c8d032-9a5c-4e66-b99b-4243bfad11a4 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:02:59.469330 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-e2c8d032-9a5c-4e66-b99b-4243bfad11a4 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] [instance: 74c5a115-b174-49fe-9b75-574e484a09e2] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:02:59.478838 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-e2c8d032-9a5c-4e66-b99b-4243bfad11a4 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:02:59.479564 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-e2c8d032-9a5c-4e66-b99b-4243bfad11a4 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:02:59.480530 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-e2c8d032-9a5c-4e66-b99b-4243bfad11a4 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:02:59.481253 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-e2c8d032-9a5c-4e66-b99b-4243bfad11a4 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:00.184342 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-e2c8d032-9a5c-4e66-b99b-4243bfad11a4 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24af0562e2aa43ca9d601be5e16fe9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ee9a43087d5497da3af9fbf68c4572d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:03:00.220951 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-e2c8d032-9a5c-4e66-b99b-4243bfad11a4 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] 10.222.0.47 "GET /compute/v2.1/servers/74c5a115-b174-49fe-9b75-574e484a09e2" status: 200 len: 1565 microversion: 2.1 time: 0.756058 Feb 19 05:03:00.239444 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 231/447] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:02:59 2021] GET /compute/v2.1/servers/74c5a115-b174-49fe-9b75-574e484a09e2 => generated 1565 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:03:00.450026 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-c6340bca-ccca-4025-81f0-bfc7bec2f490 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:03:00.451397 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-c6340bca-ccca-4025-81f0-bfc7bec2f490 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] [instance: 798b77ff-c3ca-4c65-a120-db12ad953621] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:03:00.468924 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-c6340bca-ccca-4025-81f0-bfc7bec2f490 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:00.469748 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-c6340bca-ccca-4025-81f0-bfc7bec2f490 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:00.471311 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-c6340bca-ccca-4025-81f0-bfc7bec2f490 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:00.472030 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-c6340bca-ccca-4025-81f0-bfc7bec2f490 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:00.803877 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-c6340bca-ccca-4025-81f0-bfc7bec2f490 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:03:00.814429 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-c6340bca-ccca-4025-81f0-bfc7bec2f490 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:03:00.816713 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-c6340bca-ccca-4025-81f0-bfc7bec2f490 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:03:00.818087 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-c6340bca-ccca-4025-81f0-bfc7bec2f490 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] 10.222.0.47 "GET /compute/v2.1/servers/798b77ff-c3ca-4c65-a120-db12ad953621" status: 200 len: 1723 microversion: 2.20 time: 0.385878 Feb 19 05:03:00.818763 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 217/448] 10.222.0.47 () {60 vars in 1267 bytes} [Fri Feb 19 05:03:00 2021] GET /compute/v2.1/servers/798b77ff-c3ca-4c65-a120-db12ad953621 => generated 1723 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 05:03:01.248256 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-b84afa6b-cee0-4e59-a5ee-cd35308cc2c9 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:03:01.250115 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-b84afa6b-cee0-4e59-a5ee-cd35308cc2c9 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] [instance: 74c5a115-b174-49fe-9b75-574e484a09e2] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:03:01.258218 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-b84afa6b-cee0-4e59-a5ee-cd35308cc2c9 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:01.258729 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-b84afa6b-cee0-4e59-a5ee-cd35308cc2c9 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:01.259620 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-b84afa6b-cee0-4e59-a5ee-cd35308cc2c9 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:01.260368 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-b84afa6b-cee0-4e59-a5ee-cd35308cc2c9 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:01.512130 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-b84afa6b-cee0-4e59-a5ee-cd35308cc2c9 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24af0562e2aa43ca9d601be5e16fe9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ee9a43087d5497da3af9fbf68c4572d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:03:01.523502 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-b84afa6b-cee0-4e59-a5ee-cd35308cc2c9 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] 10.222.0.47 "GET /compute/v2.1/servers/74c5a115-b174-49fe-9b75-574e484a09e2" status: 200 len: 1565 microversion: 2.1 time: 0.279200 Feb 19 05:03:01.524171 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 232/449] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:03:01 2021] GET /compute/v2.1/servers/74c5a115-b174-49fe-9b75-574e484a09e2 => generated 1565 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:03:01.841396 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-9918b05c-70cd-4863-b911-34682e5636b1 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:03:01.842521 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-9918b05c-70cd-4863-b911-34682e5636b1 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] [instance: 798b77ff-c3ca-4c65-a120-db12ad953621] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:03:01.854246 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-9918b05c-70cd-4863-b911-34682e5636b1 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:01.855052 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-9918b05c-70cd-4863-b911-34682e5636b1 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:01.855913 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-9918b05c-70cd-4863-b911-34682e5636b1 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:01.856561 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-9918b05c-70cd-4863-b911-34682e5636b1 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:02.401356 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-9918b05c-70cd-4863-b911-34682e5636b1 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:03:02.412502 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-9918b05c-70cd-4863-b911-34682e5636b1 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:03:02.414632 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-9918b05c-70cd-4863-b911-34682e5636b1 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:03:02.416166 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-9918b05c-70cd-4863-b911-34682e5636b1 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] 10.222.0.47 "GET /compute/v2.1/servers/798b77ff-c3ca-4c65-a120-db12ad953621" status: 200 len: 1723 microversion: 2.20 time: 0.580571 Feb 19 05:03:02.429963 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 218/450] 10.222.0.47 () {60 vars in 1267 bytes} [Fri Feb 19 05:03:01 2021] GET /compute/v2.1/servers/798b77ff-c3ca-4c65-a120-db12ad953621 => generated 1723 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 05:03:02.555318 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-64982070-33d4-4b68-8841-8edca38cf7ac tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:03:02.558636 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-64982070-33d4-4b68-8841-8edca38cf7ac tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] [instance: 74c5a115-b174-49fe-9b75-574e484a09e2] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:03:02.578974 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-64982070-33d4-4b68-8841-8edca38cf7ac tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:02.581031 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-64982070-33d4-4b68-8841-8edca38cf7ac tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:02.584713 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-64982070-33d4-4b68-8841-8edca38cf7ac tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:02.585903 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-64982070-33d4-4b68-8841-8edca38cf7ac tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:02.994563 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-64982070-33d4-4b68-8841-8edca38cf7ac tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24af0562e2aa43ca9d601be5e16fe9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ee9a43087d5497da3af9fbf68c4572d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:03:03.014874 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-64982070-33d4-4b68-8841-8edca38cf7ac tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] 10.222.0.47 "GET /compute/v2.1/servers/74c5a115-b174-49fe-9b75-574e484a09e2" status: 200 len: 1565 microversion: 2.1 time: 0.473556 Feb 19 05:03:03.016000 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 233/451] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:03:02 2021] GET /compute/v2.1/servers/74c5a115-b174-49fe-9b75-574e484a09e2 => generated 1565 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:03:03.442290 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-aa3b66cf-80d2-4a6c-aab4-f07fc0e4a3cc tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:03:03.443622 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-aa3b66cf-80d2-4a6c-aab4-f07fc0e4a3cc tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] [instance: 798b77ff-c3ca-4c65-a120-db12ad953621] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:03:03.455634 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-aa3b66cf-80d2-4a6c-aab4-f07fc0e4a3cc tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:03.456057 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-aa3b66cf-80d2-4a6c-aab4-f07fc0e4a3cc tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:03.456934 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-aa3b66cf-80d2-4a6c-aab4-f07fc0e4a3cc tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:03.457655 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-aa3b66cf-80d2-4a6c-aab4-f07fc0e4a3cc tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:03.718915 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-aa3b66cf-80d2-4a6c-aab4-f07fc0e4a3cc tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:03:03.730478 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-aa3b66cf-80d2-4a6c-aab4-f07fc0e4a3cc tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:03:03.732138 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-aa3b66cf-80d2-4a6c-aab4-f07fc0e4a3cc tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:03:03.733378 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-aa3b66cf-80d2-4a6c-aab4-f07fc0e4a3cc tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] 10.222.0.47 "GET /compute/v2.1/servers/798b77ff-c3ca-4c65-a120-db12ad953621" status: 200 len: 1723 microversion: 2.20 time: 0.299430 Feb 19 05:03:03.734173 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 219/452] 10.222.0.47 () {60 vars in 1267 bytes} [Fri Feb 19 05:03:03 2021] GET /compute/v2.1/servers/798b77ff-c3ca-4c65-a120-db12ad953621 => generated 1723 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 05:03:04.049564 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-dc58e4e9-3927-4446-aee1-a014cfbc4507 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:03:04.050259 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-dc58e4e9-3927-4446-aee1-a014cfbc4507 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] [instance: 74c5a115-b174-49fe-9b75-574e484a09e2] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:03:04.063382 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-dc58e4e9-3927-4446-aee1-a014cfbc4507 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:04.064788 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-dc58e4e9-3927-4446-aee1-a014cfbc4507 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:04.065987 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-dc58e4e9-3927-4446-aee1-a014cfbc4507 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:04.067140 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-dc58e4e9-3927-4446-aee1-a014cfbc4507 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:04.556760 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-dc58e4e9-3927-4446-aee1-a014cfbc4507 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24af0562e2aa43ca9d601be5e16fe9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ee9a43087d5497da3af9fbf68c4572d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:03:04.592199 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-dc58e4e9-3927-4446-aee1-a014cfbc4507 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] 10.222.0.47 "GET /compute/v2.1/servers/74c5a115-b174-49fe-9b75-574e484a09e2" status: 200 len: 1565 microversion: 2.1 time: 0.549479 Feb 19 05:03:04.623564 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 234/453] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:03:04 2021] GET /compute/v2.1/servers/74c5a115-b174-49fe-9b75-574e484a09e2 => generated 1565 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:03:04.755590 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-ff5f668c-6639-48f0-9f88-b0764596622d tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:03:04.756269 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-ff5f668c-6639-48f0-9f88-b0764596622d tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] [instance: 798b77ff-c3ca-4c65-a120-db12ad953621] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:03:04.776798 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-ff5f668c-6639-48f0-9f88-b0764596622d tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:04.778813 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-ff5f668c-6639-48f0-9f88-b0764596622d tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:04.780698 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-ff5f668c-6639-48f0-9f88-b0764596622d tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:04.786185 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-ff5f668c-6639-48f0-9f88-b0764596622d tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:05.408776 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-ff5f668c-6639-48f0-9f88-b0764596622d tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:03:05.434278 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-ff5f668c-6639-48f0-9f88-b0764596622d tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:03:05.436781 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-ff5f668c-6639-48f0-9f88-b0764596622d tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:03:05.439225 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-ff5f668c-6639-48f0-9f88-b0764596622d tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] 10.222.0.47 "GET /compute/v2.1/servers/798b77ff-c3ca-4c65-a120-db12ad953621" status: 200 len: 1723 microversion: 2.20 time: 0.687898 Feb 19 05:03:05.440119 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 220/454] 10.222.0.47 () {60 vars in 1267 bytes} [Fri Feb 19 05:03:04 2021] GET /compute/v2.1/servers/798b77ff-c3ca-4c65-a120-db12ad953621 => generated 1723 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 05:03:05.636700 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-1331dab3-1a58-4eb9-b5b6-b0634738f03c tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:03:05.638025 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-1331dab3-1a58-4eb9-b5b6-b0634738f03c tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] [instance: 74c5a115-b174-49fe-9b75-574e484a09e2] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:03:05.668476 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-1331dab3-1a58-4eb9-b5b6-b0634738f03c tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:05.670005 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-1331dab3-1a58-4eb9-b5b6-b0634738f03c tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:05.672078 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-1331dab3-1a58-4eb9-b5b6-b0634738f03c tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:05.673058 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-1331dab3-1a58-4eb9-b5b6-b0634738f03c tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:06.380013 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-1331dab3-1a58-4eb9-b5b6-b0634738f03c tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24af0562e2aa43ca9d601be5e16fe9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ee9a43087d5497da3af9fbf68c4572d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:03:06.410116 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-1331dab3-1a58-4eb9-b5b6-b0634738f03c tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] 10.222.0.47 "GET /compute/v2.1/servers/74c5a115-b174-49fe-9b75-574e484a09e2" status: 200 len: 1565 microversion: 2.1 time: 0.782879 Feb 19 05:03:06.426808 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 235/455] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:03:05 2021] GET /compute/v2.1/servers/74c5a115-b174-49fe-9b75-574e484a09e2 => generated 1565 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:03:06.461121 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-f8d1b84c-ee59-4af2-85cb-b0f11bb0d8e6 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:03:06.462464 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-f8d1b84c-ee59-4af2-85cb-b0f11bb0d8e6 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] [instance: 798b77ff-c3ca-4c65-a120-db12ad953621] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:03:06.477294 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-f8d1b84c-ee59-4af2-85cb-b0f11bb0d8e6 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:06.478002 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-f8d1b84c-ee59-4af2-85cb-b0f11bb0d8e6 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:06.479145 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-f8d1b84c-ee59-4af2-85cb-b0f11bb0d8e6 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:06.479918 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-f8d1b84c-ee59-4af2-85cb-b0f11bb0d8e6 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:06.777046 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-f8d1b84c-ee59-4af2-85cb-b0f11bb0d8e6 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:03:06.787875 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-f8d1b84c-ee59-4af2-85cb-b0f11bb0d8e6 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:03:06.789572 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-f8d1b84c-ee59-4af2-85cb-b0f11bb0d8e6 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:03:06.790862 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-f8d1b84c-ee59-4af2-85cb-b0f11bb0d8e6 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] 10.222.0.47 "GET /compute/v2.1/servers/798b77ff-c3ca-4c65-a120-db12ad953621" status: 200 len: 1723 microversion: 2.20 time: 0.333956 Feb 19 05:03:06.791514 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 221/456] 10.222.0.47 () {60 vars in 1267 bytes} [Fri Feb 19 05:03:06 2021] GET /compute/v2.1/servers/798b77ff-c3ca-4c65-a120-db12ad953621 => generated 1723 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 05:03:07.435190 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-a56c6b5e-9e3d-4bc1-b1d9-aaa3f22bcd70 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:03:07.436278 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-a56c6b5e-9e3d-4bc1-b1d9-aaa3f22bcd70 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] [instance: 74c5a115-b174-49fe-9b75-574e484a09e2] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:03:07.445797 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-a56c6b5e-9e3d-4bc1-b1d9-aaa3f22bcd70 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:07.446405 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-a56c6b5e-9e3d-4bc1-b1d9-aaa3f22bcd70 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:07.447304 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-a56c6b5e-9e3d-4bc1-b1d9-aaa3f22bcd70 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:07.447825 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-a56c6b5e-9e3d-4bc1-b1d9-aaa3f22bcd70 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:07.788483 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-a56c6b5e-9e3d-4bc1-b1d9-aaa3f22bcd70 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24af0562e2aa43ca9d601be5e16fe9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ee9a43087d5497da3af9fbf68c4572d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:03:07.800870 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-a56c6b5e-9e3d-4bc1-b1d9-aaa3f22bcd70 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] 10.222.0.47 "GET /compute/v2.1/servers/74c5a115-b174-49fe-9b75-574e484a09e2" status: 200 len: 1565 microversion: 2.1 time: 0.370270 Feb 19 05:03:07.801732 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 236/457] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:03:07 2021] GET /compute/v2.1/servers/74c5a115-b174-49fe-9b75-574e484a09e2 => generated 1565 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 05:03:07.820703 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-0da8a4b7-a9aa-4477-96ae-fde6c0c8f599 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:03:07.821559 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-0da8a4b7-a9aa-4477-96ae-fde6c0c8f599 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] [instance: 798b77ff-c3ca-4c65-a120-db12ad953621] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:03:07.832052 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-0da8a4b7-a9aa-4477-96ae-fde6c0c8f599 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:07.832900 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-0da8a4b7-a9aa-4477-96ae-fde6c0c8f599 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:07.834157 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-0da8a4b7-a9aa-4477-96ae-fde6c0c8f599 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:07.834788 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-0da8a4b7-a9aa-4477-96ae-fde6c0c8f599 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:08.202311 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-0da8a4b7-a9aa-4477-96ae-fde6c0c8f599 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:03:08.213844 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-0da8a4b7-a9aa-4477-96ae-fde6c0c8f599 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:03:08.215383 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-0da8a4b7-a9aa-4477-96ae-fde6c0c8f599 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:03:08.216756 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-0da8a4b7-a9aa-4477-96ae-fde6c0c8f599 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] 10.222.0.47 "GET /compute/v2.1/servers/798b77ff-c3ca-4c65-a120-db12ad953621" status: 200 len: 1723 microversion: 2.20 time: 0.406978 Feb 19 05:03:08.217338 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 222/458] 10.222.0.47 () {60 vars in 1267 bytes} [Fri Feb 19 05:03:07 2021] GET /compute/v2.1/servers/798b77ff-c3ca-4c65-a120-db12ad953621 => generated 1723 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 05:03:08.834206 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-2db0b8e7-c249-437c-a986-000193ac1fed tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:03:08.847658 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-2db0b8e7-c249-437c-a986-000193ac1fed tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] [instance: 74c5a115-b174-49fe-9b75-574e484a09e2] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:03:08.874643 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-2db0b8e7-c249-437c-a986-000193ac1fed tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:08.875588 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-2db0b8e7-c249-437c-a986-000193ac1fed tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:08.877383 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-2db0b8e7-c249-437c-a986-000193ac1fed tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:08.879085 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-2db0b8e7-c249-437c-a986-000193ac1fed tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:09.248829 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-f24e7a58-7927-432d-9dce-637e01d4b438 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:03:09.253934 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-f24e7a58-7927-432d-9dce-637e01d4b438 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] [instance: 798b77ff-c3ca-4c65-a120-db12ad953621] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:03:09.294572 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-f24e7a58-7927-432d-9dce-637e01d4b438 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:09.295958 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-f24e7a58-7927-432d-9dce-637e01d4b438 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:09.297844 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-f24e7a58-7927-432d-9dce-637e01d4b438 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:09.300130 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-f24e7a58-7927-432d-9dce-637e01d4b438 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:09.711610 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-2db0b8e7-c249-437c-a986-000193ac1fed tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24af0562e2aa43ca9d601be5e16fe9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ee9a43087d5497da3af9fbf68c4572d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:03:09.760482 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-2db0b8e7-c249-437c-a986-000193ac1fed tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] 10.222.0.47 "GET /compute/v2.1/servers/74c5a115-b174-49fe-9b75-574e484a09e2" status: 200 len: 1565 microversion: 2.1 time: 0.934847 Feb 19 05:03:09.762225 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 237/459] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:03:08 2021] GET /compute/v2.1/servers/74c5a115-b174-49fe-9b75-574e484a09e2 => generated 1565 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:03:09.790352 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [req-771fba05-e125-4ab5-a4dc-4b63f54d5b56 req-ceffd860-de0a-465b-835f-75ef88db57b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "798b77ff-c3ca-4c65-a120-db12ad953621", "name": "network-vif-unplugged", "status": "completed", "tag": "6af5e97b-75ed-4d80-88eb-6ea5c37a0234"}]} {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:03:09.806946 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 05:03:09.806946 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: warnings.warn(msg) Feb 19 05:03:09.858610 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [req-771fba05-e125-4ab5-a4dc-4b63f54d5b56 req-ceffd860-de0a-465b-835f-75ef88db57b5 service nova] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:09.859524 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [req-771fba05-e125-4ab5-a4dc-4b63f54d5b56 req-ceffd860-de0a-465b-835f-75ef88db57b5 service nova] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:09.977736 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.compute.server_external_events [req-771fba05-e125-4ab5-a4dc-4b63f54d5b56 req-ceffd860-de0a-465b-835f-75ef88db57b5 service nova] Unable to find a host for instance 798b77ff-c3ca-4c65-a120-db12ad953621. Dropping event network-vif-unplugged {{(pid=98154) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:141}} Feb 19 05:03:09.984414 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [req-771fba05-e125-4ab5-a4dc-4b63f54d5b56 req-ceffd860-de0a-465b-835f-75ef88db57b5 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.214892 Feb 19 05:03:09.985951 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 238/460] 10.222.0.47 () {64 vars in 1308 bytes} [Fri Feb 19 05:03:09 2021] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 222 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Feb 19 05:03:10.073219 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-f24e7a58-7927-432d-9dce-637e01d4b438 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:03:10.091771 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-f24e7a58-7927-432d-9dce-637e01d4b438 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:03:10.093767 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-f24e7a58-7927-432d-9dce-637e01d4b438 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:03:10.095456 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-f24e7a58-7927-432d-9dce-637e01d4b438 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] 10.222.0.47 "GET /compute/v2.1/servers/798b77ff-c3ca-4c65-a120-db12ad953621" status: 200 len: 1726 microversion: 2.20 time: 0.854487 Feb 19 05:03:10.096482 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 223/461] 10.222.0.47 () {60 vars in 1267 bytes} [Fri Feb 19 05:03:09 2021] GET /compute/v2.1/servers/798b77ff-c3ca-4c65-a120-db12ad953621 => generated 1726 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 05:03:10.119402 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-a0dfb1ad-b3e3-4b94-8c87-6b73d5a5e0a7 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cf5e3a67-8d86-4218-a407-efea023bc118"}} {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:03:10.120993 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-a0dfb1ad-b3e3-4b94-8c87-6b73d5a5e0a7 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] [instance: 798b77ff-c3ca-4c65-a120-db12ad953621] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:03:10.132629 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-a0dfb1ad-b3e3-4b94-8c87-6b73d5a5e0a7 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:10.133438 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-a0dfb1ad-b3e3-4b94-8c87-6b73d5a5e0a7 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:10.134487 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-a0dfb1ad-b3e3-4b94-8c87-6b73d5a5e0a7 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:10.135423 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-a0dfb1ad-b3e3-4b94-8c87-6b73d5a5e0a7 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:10.192443 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-e3753223-bed5-43db-824e-a3e728c7e2c6 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:03:10.193003 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-e3753223-bed5-43db-824e-a3e728c7e2c6 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] [instance: d49e68e7-1b06-45d5-b811-440fe0435ed4] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:03:10.209859 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-e3753223-bed5-43db-824e-a3e728c7e2c6 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:10.210759 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-e3753223-bed5-43db-824e-a3e728c7e2c6 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:10.212337 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-e3753223-bed5-43db-824e-a3e728c7e2c6 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:10.213885 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-e3753223-bed5-43db-824e-a3e728c7e2c6 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:10.405182 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-e3753223-bed5-43db-824e-a3e728c7e2c6 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] [instance: d49e68e7-1b06-45d5-b811-440fe0435ed4] Going to try to terminate instance {{(pid=98153) delete /opt/stack/nova/nova/compute/api.py:2540}} Feb 19 05:03:10.655120 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-e3753223-bed5-43db-824e-a3e728c7e2c6 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] 10.222.0.47 "DELETE /compute/v2.1/servers/d49e68e7-1b06-45d5-b811-440fe0435ed4" status: 204 len: 0 microversion: 2.1 time: 0.466597 Feb 19 05:03:10.656285 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 224/462] 10.222.0.47 () {58 vars in 1229 bytes} [Fri Feb 19 05:03:10 2021] DELETE /compute/v2.1/servers/d49e68e7-1b06-45d5-b811-440fe0435ed4 => generated 0 bytes in 469 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Feb 19 05:03:10.670573 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-cf3eb853-e87f-4901-af80-e89887082e23 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:03:10.671822 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-cf3eb853-e87f-4901-af80-e89887082e23 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] [instance: d49e68e7-1b06-45d5-b811-440fe0435ed4] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:03:10.682469 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-cf3eb853-e87f-4901-af80-e89887082e23 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:10.683241 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-cf3eb853-e87f-4901-af80-e89887082e23 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:10.684283 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-cf3eb853-e87f-4901-af80-e89887082e23 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:10.684886 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-cf3eb853-e87f-4901-af80-e89887082e23 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:11.037878 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-cf3eb853-e87f-4901-af80-e89887082e23 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628d846121a14be78329ccc727c8869d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa473e12960449bbb0713a709e0abe4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:03:11.051198 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-cf3eb853-e87f-4901-af80-e89887082e23 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] 10.222.0.47 "GET /compute/v2.1/servers/d49e68e7-1b06-45d5-b811-440fe0435ed4" status: 200 len: 1515 microversion: 2.1 time: 0.387702 Feb 19 05:03:11.052278 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 225/463] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:03:10 2021] GET /compute/v2.1/servers/d49e68e7-1b06-45d5-b811-440fe0435ed4 => generated 1515 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:03:11.057688 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-d97e74f1-b4ba-4417-ba95-17f4a1674394 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:03:11.058611 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-d97e74f1-b4ba-4417-ba95-17f4a1674394 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] [instance: 74c5a115-b174-49fe-9b75-574e484a09e2] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:03:11.068627 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-d97e74f1-b4ba-4417-ba95-17f4a1674394 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:11.069448 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-d97e74f1-b4ba-4417-ba95-17f4a1674394 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:11.070768 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-d97e74f1-b4ba-4417-ba95-17f4a1674394 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:11.072074 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-d97e74f1-b4ba-4417-ba95-17f4a1674394 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:11.143630 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-a0dfb1ad-b3e3-4b94-8c87-6b73d5a5e0a7 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] 10.222.0.47 "POST /compute/v2.1/servers/798b77ff-c3ca-4c65-a120-db12ad953621/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.027117 Feb 19 05:03:11.144957 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 239/464] 10.222.0.47 () {62 vars in 1354 bytes} [Fri Feb 19 05:03:10 2021] POST /compute/v2.1/servers/798b77ff-c3ca-4c65-a120-db12ad953621/os-volume_attachments => generated 188 bytes in 1031 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 19 05:03:11.380702 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-77e89edc-c7e3-4524-9286-2925fb46e155 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:03:11.381382 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-d97e74f1-b4ba-4417-ba95-17f4a1674394 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24af0562e2aa43ca9d601be5e16fe9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ee9a43087d5497da3af9fbf68c4572d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:03:11.382030 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-77e89edc-c7e3-4524-9286-2925fb46e155 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] [instance: 798b77ff-c3ca-4c65-a120-db12ad953621] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:03:11.397542 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-d97e74f1-b4ba-4417-ba95-17f4a1674394 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] 10.222.0.47 "GET /compute/v2.1/servers/74c5a115-b174-49fe-9b75-574e484a09e2" status: 200 len: 1565 microversion: 2.1 time: 0.343909 Feb 19 05:03:11.398694 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 226/465] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:03:11 2021] GET /compute/v2.1/servers/74c5a115-b174-49fe-9b75-574e484a09e2 => generated 1565 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:03:11.401961 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-77e89edc-c7e3-4524-9286-2925fb46e155 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:11.403060 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-77e89edc-c7e3-4524-9286-2925fb46e155 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:11.405228 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-77e89edc-c7e3-4524-9286-2925fb46e155 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:11.406990 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-77e89edc-c7e3-4524-9286-2925fb46e155 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:11.745793 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-77e89edc-c7e3-4524-9286-2925fb46e155 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] 10.222.0.47 "POST /compute/v2.1/servers/798b77ff-c3ca-4c65-a120-db12ad953621/action" status: 202 len: 0 microversion: 2.20 time: 0.374610 Feb 19 05:03:11.747322 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 240/466] 10.222.0.47 () {62 vars in 1309 bytes} [Fri Feb 19 05:03:11 2021] POST /compute/v2.1/servers/798b77ff-c3ca-4c65-a120-db12ad953621/action => generated 0 bytes in 379 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Feb 19 05:03:11.770378 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-68b17d23-3492-441a-99ea-c008e45aae56 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:03:11.776101 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-68b17d23-3492-441a-99ea-c008e45aae56 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] [instance: 798b77ff-c3ca-4c65-a120-db12ad953621] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:03:11.792982 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-68b17d23-3492-441a-99ea-c008e45aae56 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:11.794057 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-68b17d23-3492-441a-99ea-c008e45aae56 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:11.799774 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-68b17d23-3492-441a-99ea-c008e45aae56 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:11.800303 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-68b17d23-3492-441a-99ea-c008e45aae56 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:12.085606 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-b2783f2d-42bc-4d41-8616-4dfa799026f4 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:03:12.088262 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-b2783f2d-42bc-4d41-8616-4dfa799026f4 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] [instance: d49e68e7-1b06-45d5-b811-440fe0435ed4] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:03:12.107264 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-b2783f2d-42bc-4d41-8616-4dfa799026f4 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:12.118369 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-b2783f2d-42bc-4d41-8616-4dfa799026f4 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:12.119504 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-b2783f2d-42bc-4d41-8616-4dfa799026f4 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:12.120117 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-b2783f2d-42bc-4d41-8616-4dfa799026f4 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:12.216109 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-68b17d23-3492-441a-99ea-c008e45aae56 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:03:12.238303 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-68b17d23-3492-441a-99ea-c008e45aae56 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:03:12.251416 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-68b17d23-3492-441a-99ea-c008e45aae56 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:03:12.266637 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-68b17d23-3492-441a-99ea-c008e45aae56 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] 10.222.0.47 "GET /compute/v2.1/servers/798b77ff-c3ca-4c65-a120-db12ad953621" status: 200 len: 1752 microversion: 2.20 time: 0.511795 Feb 19 05:03:12.271539 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 227/467] 10.222.0.47 () {60 vars in 1267 bytes} [Fri Feb 19 05:03:11 2021] GET /compute/v2.1/servers/798b77ff-c3ca-4c65-a120-db12ad953621 => generated 1752 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 05:03:12.429660 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-20fc6d48-3216-4909-af3f-13d8e5c7c1a6 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:03:12.430886 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-20fc6d48-3216-4909-af3f-13d8e5c7c1a6 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] [instance: 74c5a115-b174-49fe-9b75-574e484a09e2] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:03:12.466821 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-20fc6d48-3216-4909-af3f-13d8e5c7c1a6 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:12.468326 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-20fc6d48-3216-4909-af3f-13d8e5c7c1a6 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:12.469275 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-20fc6d48-3216-4909-af3f-13d8e5c7c1a6 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:12.471576 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-20fc6d48-3216-4909-af3f-13d8e5c7c1a6 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:12.538155 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-b2783f2d-42bc-4d41-8616-4dfa799026f4 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628d846121a14be78329ccc727c8869d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa473e12960449bbb0713a709e0abe4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:03:12.552577 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-b2783f2d-42bc-4d41-8616-4dfa799026f4 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] 10.222.0.47 "GET /compute/v2.1/servers/d49e68e7-1b06-45d5-b811-440fe0435ed4" status: 200 len: 1515 microversion: 2.1 time: 0.474561 Feb 19 05:03:12.553532 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 241/468] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:03:12 2021] GET /compute/v2.1/servers/d49e68e7-1b06-45d5-b811-440fe0435ed4 => generated 1515 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 05:03:12.781320 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-20fc6d48-3216-4909-af3f-13d8e5c7c1a6 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24af0562e2aa43ca9d601be5e16fe9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ee9a43087d5497da3af9fbf68c4572d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:03:12.814195 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-20fc6d48-3216-4909-af3f-13d8e5c7c1a6 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] 10.222.0.47 "GET /compute/v2.1/servers/74c5a115-b174-49fe-9b75-574e484a09e2" status: 200 len: 1565 microversion: 2.1 time: 0.391109 Feb 19 05:03:12.825329 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 228/469] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:03:12 2021] GET /compute/v2.1/servers/74c5a115-b174-49fe-9b75-574e484a09e2 => generated 1565 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 05:03:13.289485 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-c76442a4-f829-490f-a2d1-b255ab2e6804 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:03:13.290167 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-c76442a4-f829-490f-a2d1-b255ab2e6804 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] [instance: 798b77ff-c3ca-4c65-a120-db12ad953621] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:03:13.298664 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-c76442a4-f829-490f-a2d1-b255ab2e6804 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:13.299165 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-c76442a4-f829-490f-a2d1-b255ab2e6804 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:13.300072 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-c76442a4-f829-490f-a2d1-b255ab2e6804 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:13.300565 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-c76442a4-f829-490f-a2d1-b255ab2e6804 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:13.524438 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-c76442a4-f829-490f-a2d1-b255ab2e6804 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:03:13.535724 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-c76442a4-f829-490f-a2d1-b255ab2e6804 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:03:13.537315 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-c76442a4-f829-490f-a2d1-b255ab2e6804 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:03:13.538584 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-c76442a4-f829-490f-a2d1-b255ab2e6804 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] 10.222.0.47 "GET /compute/v2.1/servers/798b77ff-c3ca-4c65-a120-db12ad953621" status: 200 len: 1752 microversion: 2.20 time: 0.253438 Feb 19 05:03:13.539213 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 242/470] 10.222.0.47 () {60 vars in 1267 bytes} [Fri Feb 19 05:03:13 2021] GET /compute/v2.1/servers/798b77ff-c3ca-4c65-a120-db12ad953621 => generated 1752 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 05:03:13.585483 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-6690a6ab-97a3-4882-a851-88c96cd49dd1 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:03:13.586167 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-6690a6ab-97a3-4882-a851-88c96cd49dd1 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] [instance: d49e68e7-1b06-45d5-b811-440fe0435ed4] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:03:13.595635 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-6690a6ab-97a3-4882-a851-88c96cd49dd1 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:13.596205 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-6690a6ab-97a3-4882-a851-88c96cd49dd1 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:13.597098 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-6690a6ab-97a3-4882-a851-88c96cd49dd1 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:13.597595 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-6690a6ab-97a3-4882-a851-88c96cd49dd1 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:13.853278 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-9a1d4c39-4fef-4d12-af89-27b404938599 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:03:13.854092 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-9a1d4c39-4fef-4d12-af89-27b404938599 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] [instance: 74c5a115-b174-49fe-9b75-574e484a09e2] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:03:13.855178 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-6690a6ab-97a3-4882-a851-88c96cd49dd1 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628d846121a14be78329ccc727c8869d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa473e12960449bbb0713a709e0abe4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:03:13.865187 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-9a1d4c39-4fef-4d12-af89-27b404938599 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:13.865809 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-9a1d4c39-4fef-4d12-af89-27b404938599 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:13.866788 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-9a1d4c39-4fef-4d12-af89-27b404938599 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:13.867394 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-9a1d4c39-4fef-4d12-af89-27b404938599 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:13.867630 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-6690a6ab-97a3-4882-a851-88c96cd49dd1 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] 10.222.0.47 "GET /compute/v2.1/servers/d49e68e7-1b06-45d5-b811-440fe0435ed4" status: 200 len: 1515 microversion: 2.1 time: 0.287132 Feb 19 05:03:13.868520 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 229/471] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:03:13 2021] GET /compute/v2.1/servers/d49e68e7-1b06-45d5-b811-440fe0435ed4 => generated 1515 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:03:14.280463 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-9a1d4c39-4fef-4d12-af89-27b404938599 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24af0562e2aa43ca9d601be5e16fe9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ee9a43087d5497da3af9fbf68c4572d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:03:14.294180 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-9a1d4c39-4fef-4d12-af89-27b404938599 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] 10.222.0.47 "GET /compute/v2.1/servers/74c5a115-b174-49fe-9b75-574e484a09e2" status: 200 len: 1565 microversion: 2.1 time: 0.445844 Feb 19 05:03:14.295132 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 243/472] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:03:13 2021] GET /compute/v2.1/servers/74c5a115-b174-49fe-9b75-574e484a09e2 => generated 1565 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 05:03:14.561185 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-8b634b4f-589e-4570-9e22-56f337c27b27 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:03:14.564816 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-8b634b4f-589e-4570-9e22-56f337c27b27 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] [instance: 798b77ff-c3ca-4c65-a120-db12ad953621] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:03:14.574273 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-8b634b4f-589e-4570-9e22-56f337c27b27 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:14.574955 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-8b634b4f-589e-4570-9e22-56f337c27b27 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:14.576093 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-8b634b4f-589e-4570-9e22-56f337c27b27 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:14.576675 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-8b634b4f-589e-4570-9e22-56f337c27b27 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:14.873520 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-8b634b4f-589e-4570-9e22-56f337c27b27 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:03:14.884679 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-8b634b4f-589e-4570-9e22-56f337c27b27 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:03:14.886942 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-8b634b4f-589e-4570-9e22-56f337c27b27 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:03:14.888537 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-8b634b4f-589e-4570-9e22-56f337c27b27 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] 10.222.0.47 "GET /compute/v2.1/servers/798b77ff-c3ca-4c65-a120-db12ad953621" status: 200 len: 1754 microversion: 2.20 time: 0.332941 Feb 19 05:03:14.889334 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 230/473] 10.222.0.47 () {60 vars in 1267 bytes} [Fri Feb 19 05:03:14 2021] GET /compute/v2.1/servers/798b77ff-c3ca-4c65-a120-db12ad953621 => generated 1754 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 05:03:14.897242 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-c2179126-4362-4255-afdd-c35a0bf75e2f tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:03:14.898255 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-c2179126-4362-4255-afdd-c35a0bf75e2f tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] [instance: d49e68e7-1b06-45d5-b811-440fe0435ed4] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:03:14.911478 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-c2179126-4362-4255-afdd-c35a0bf75e2f tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:14.912360 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-c2179126-4362-4255-afdd-c35a0bf75e2f tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:14.914029 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-c2179126-4362-4255-afdd-c35a0bf75e2f tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:14.914923 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-c2179126-4362-4255-afdd-c35a0bf75e2f tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:15.187159 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-c2179126-4362-4255-afdd-c35a0bf75e2f tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628d846121a14be78329ccc727c8869d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa473e12960449bbb0713a709e0abe4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:03:15.197802 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-c2179126-4362-4255-afdd-c35a0bf75e2f tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] 10.222.0.47 "GET /compute/v2.1/servers/d49e68e7-1b06-45d5-b811-440fe0435ed4" status: 200 len: 1515 microversion: 2.1 time: 0.307147 Feb 19 05:03:15.198467 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 244/474] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:03:14 2021] GET /compute/v2.1/servers/d49e68e7-1b06-45d5-b811-440fe0435ed4 => generated 1515 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 05:03:15.334422 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-61069f12-7cad-4eaa-82f8-6e8f06cf9208 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:03:15.335171 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-61069f12-7cad-4eaa-82f8-6e8f06cf9208 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] [instance: 74c5a115-b174-49fe-9b75-574e484a09e2] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:03:15.343689 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-61069f12-7cad-4eaa-82f8-6e8f06cf9208 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:15.344264 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-61069f12-7cad-4eaa-82f8-6e8f06cf9208 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:15.345763 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-61069f12-7cad-4eaa-82f8-6e8f06cf9208 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:15.346283 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-61069f12-7cad-4eaa-82f8-6e8f06cf9208 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:15.748795 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-61069f12-7cad-4eaa-82f8-6e8f06cf9208 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24af0562e2aa43ca9d601be5e16fe9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ee9a43087d5497da3af9fbf68c4572d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:03:15.771250 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-61069f12-7cad-4eaa-82f8-6e8f06cf9208 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] 10.222.0.47 "GET /compute/v2.1/servers/74c5a115-b174-49fe-9b75-574e484a09e2" status: 200 len: 1565 microversion: 2.1 time: 0.452560 Feb 19 05:03:15.772603 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 231/475] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:03:15 2021] GET /compute/v2.1/servers/74c5a115-b174-49fe-9b75-574e484a09e2 => generated 1565 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 05:03:15.915926 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-f1eb2d37-5ca3-4241-b715-412f7e16618a tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:03:15.917103 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-f1eb2d37-5ca3-4241-b715-412f7e16618a tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] [instance: 798b77ff-c3ca-4c65-a120-db12ad953621] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:03:15.971368 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-f1eb2d37-5ca3-4241-b715-412f7e16618a tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:15.971368 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-f1eb2d37-5ca3-4241-b715-412f7e16618a tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:15.972275 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-f1eb2d37-5ca3-4241-b715-412f7e16618a tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:15.979917 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-f1eb2d37-5ca3-4241-b715-412f7e16618a tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:16.221331 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-d71e9c64-aa93-4644-8b1a-fafff843fcb1 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:03:16.222114 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-d71e9c64-aa93-4644-8b1a-fafff843fcb1 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] [instance: d49e68e7-1b06-45d5-b811-440fe0435ed4] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:03:16.230872 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-d71e9c64-aa93-4644-8b1a-fafff843fcb1 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:16.231506 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-d71e9c64-aa93-4644-8b1a-fafff843fcb1 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:16.232430 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-d71e9c64-aa93-4644-8b1a-fafff843fcb1 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:16.233107 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-d71e9c64-aa93-4644-8b1a-fafff843fcb1 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:16.409293 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-f1eb2d37-5ca3-4241-b715-412f7e16618a tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:03:16.437088 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-f1eb2d37-5ca3-4241-b715-412f7e16618a tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:03:16.443691 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-f1eb2d37-5ca3-4241-b715-412f7e16618a tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:03:16.446300 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-f1eb2d37-5ca3-4241-b715-412f7e16618a tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] 10.222.0.47 "GET /compute/v2.1/servers/798b77ff-c3ca-4c65-a120-db12ad953621" status: 200 len: 1754 microversion: 2.20 time: 0.538567 Feb 19 05:03:16.448305 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 245/476] 10.222.0.47 () {60 vars in 1267 bytes} [Fri Feb 19 05:03:15 2021] GET /compute/v2.1/servers/798b77ff-c3ca-4c65-a120-db12ad953621 => generated 1754 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 05:03:16.531436 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-d71e9c64-aa93-4644-8b1a-fafff843fcb1 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628d846121a14be78329ccc727c8869d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa473e12960449bbb0713a709e0abe4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:03:16.545238 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-d71e9c64-aa93-4644-8b1a-fafff843fcb1 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] 10.222.0.47 "GET /compute/v2.1/servers/d49e68e7-1b06-45d5-b811-440fe0435ed4" status: 200 len: 1515 microversion: 2.1 time: 0.328770 Feb 19 05:03:16.546391 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 232/477] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:03:16 2021] GET /compute/v2.1/servers/d49e68e7-1b06-45d5-b811-440fe0435ed4 => generated 1515 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 05:03:16.804766 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-db022890-5dd6-4fa4-bab2-8c7f2e2b0883 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:03:16.806640 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-db022890-5dd6-4fa4-bab2-8c7f2e2b0883 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] [instance: 74c5a115-b174-49fe-9b75-574e484a09e2] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:03:16.825138 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-db022890-5dd6-4fa4-bab2-8c7f2e2b0883 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:16.826136 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-db022890-5dd6-4fa4-bab2-8c7f2e2b0883 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:16.828075 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-db022890-5dd6-4fa4-bab2-8c7f2e2b0883 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:16.829607 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-db022890-5dd6-4fa4-bab2-8c7f2e2b0883 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:17.380895 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-db022890-5dd6-4fa4-bab2-8c7f2e2b0883 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24af0562e2aa43ca9d601be5e16fe9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ee9a43087d5497da3af9fbf68c4572d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:03:17.393691 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-db022890-5dd6-4fa4-bab2-8c7f2e2b0883 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] 10.222.0.47 "GET /compute/v2.1/servers/74c5a115-b174-49fe-9b75-574e484a09e2" status: 200 len: 1565 microversion: 2.1 time: 0.597812 Feb 19 05:03:17.399457 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 246/478] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:03:16 2021] GET /compute/v2.1/servers/74c5a115-b174-49fe-9b75-574e484a09e2 => generated 1565 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:03:17.486117 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-252136cc-6392-4743-88ea-7ee81c5f5c73 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:03:17.487364 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-252136cc-6392-4743-88ea-7ee81c5f5c73 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] [instance: 798b77ff-c3ca-4c65-a120-db12ad953621] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:03:17.523532 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-252136cc-6392-4743-88ea-7ee81c5f5c73 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:17.524409 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-252136cc-6392-4743-88ea-7ee81c5f5c73 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:17.527701 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-252136cc-6392-4743-88ea-7ee81c5f5c73 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:17.534146 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-252136cc-6392-4743-88ea-7ee81c5f5c73 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:17.582717 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-9b7a69f3-00ae-4afd-b037-43912df91c2f tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:03:17.584698 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-9b7a69f3-00ae-4afd-b037-43912df91c2f tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] [instance: d49e68e7-1b06-45d5-b811-440fe0435ed4] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:03:17.604232 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-9b7a69f3-00ae-4afd-b037-43912df91c2f tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:17.605377 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-9b7a69f3-00ae-4afd-b037-43912df91c2f tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:17.608393 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-9b7a69f3-00ae-4afd-b037-43912df91c2f tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:17.609473 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-9b7a69f3-00ae-4afd-b037-43912df91c2f tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:18.364690 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-252136cc-6392-4743-88ea-7ee81c5f5c73 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:03:18.378532 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-252136cc-6392-4743-88ea-7ee81c5f5c73 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:03:18.380633 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-252136cc-6392-4743-88ea-7ee81c5f5c73 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:03:18.382191 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-252136cc-6392-4743-88ea-7ee81c5f5c73 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] 10.222.0.47 "GET /compute/v2.1/servers/798b77ff-c3ca-4c65-a120-db12ad953621" status: 200 len: 1754 microversion: 2.20 time: 0.905686 Feb 19 05:03:18.395946 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 233/479] 10.222.0.47 () {60 vars in 1267 bytes} [Fri Feb 19 05:03:17 2021] GET /compute/v2.1/servers/798b77ff-c3ca-4c65-a120-db12ad953621 => generated 1754 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 05:03:18.409776 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-9b7a69f3-00ae-4afd-b037-43912df91c2f tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628d846121a14be78329ccc727c8869d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa473e12960449bbb0713a709e0abe4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:03:18.417327 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-53f054c6-6d58-4e23-824d-431712c98abc tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:03:18.418165 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-53f054c6-6d58-4e23-824d-431712c98abc tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] [instance: 74c5a115-b174-49fe-9b75-574e484a09e2] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:03:18.426189 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-9b7a69f3-00ae-4afd-b037-43912df91c2f tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] 10.222.0.47 "GET /compute/v2.1/servers/d49e68e7-1b06-45d5-b811-440fe0435ed4" status: 200 len: 1515 microversion: 2.1 time: 0.853127 Feb 19 05:03:18.427630 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-53f054c6-6d58-4e23-824d-431712c98abc tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:18.428274 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-53f054c6-6d58-4e23-824d-431712c98abc tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:18.429629 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-53f054c6-6d58-4e23-824d-431712c98abc tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:18.430297 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-53f054c6-6d58-4e23-824d-431712c98abc tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:18.440313 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 247/480] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:03:17 2021] GET /compute/v2.1/servers/d49e68e7-1b06-45d5-b811-440fe0435ed4 => generated 1515 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:03:18.703912 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-daf13722-1fed-4019-9821-5ee352111468 tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:03:18.705859 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-daf13722-1fed-4019-9821-5ee352111468 tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] [instance: 0d55dde2-c4d7-4da3-9f14-2e6a30f69bcb] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:03:18.732338 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-daf13722-1fed-4019-9821-5ee352111468 tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:18.733302 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-daf13722-1fed-4019-9821-5ee352111468 tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:18.734820 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-daf13722-1fed-4019-9821-5ee352111468 tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:18.737545 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-daf13722-1fed-4019-9821-5ee352111468 tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:19.034233 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.objects.instance [None req-daf13722-1fed-4019-9821-5ee352111468 tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Lazy-loading 'services' on Instance uuid 0d55dde2-c4d7-4da3-9f14-2e6a30f69bcb {{(pid=98154) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Feb 19 05:03:19.192460 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-53f054c6-6d58-4e23-824d-431712c98abc tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24af0562e2aa43ca9d601be5e16fe9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ee9a43087d5497da3af9fbf68c4572d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:03:19.212480 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-53f054c6-6d58-4e23-824d-431712c98abc tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] 10.222.0.47 "GET /compute/v2.1/servers/74c5a115-b174-49fe-9b75-574e484a09e2" status: 200 len: 1545 microversion: 2.1 time: 0.799184 Feb 19 05:03:19.213627 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 234/481] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:03:18 2021] GET /compute/v2.1/servers/74c5a115-b174-49fe-9b75-574e484a09e2 => generated 1545 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 05:03:19.223479 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [req-f700b569-f79a-458d-93db-53efcca97ad8 req-803f1528-2a52-4033-8b4f-4f72b502e699 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d49e68e7-1b06-45d5-b811-440fe0435ed4", "name": "network-vif-deleted", "tag": "8b909732-be36-45f2-ab6d-689515c337d4"}]} {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:03:19.225658 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 05:03:19.225658 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: warnings.warn(msg) Feb 19 05:03:19.238007 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [req-f700b569-f79a-458d-93db-53efcca97ad8 req-803f1528-2a52-4033-8b4f-4f72b502e699 service nova] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:19.238651 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [req-f700b569-f79a-458d-93db-53efcca97ad8 req-803f1528-2a52-4033-8b4f-4f72b502e699 service nova] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:19.261055 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.compute.server_external_events [req-f700b569-f79a-458d-93db-53efcca97ad8 req-803f1528-2a52-4033-8b4f-4f72b502e699 service nova] Creating event network-vif-deleted:8b909732-be36-45f2-ab6d-689515c337d4 for instance d49e68e7-1b06-45d5-b811-440fe0435ed4 on hv-cinder-77642 Feb 19 05:03:19.268777 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [req-f700b569-f79a-458d-93db-53efcca97ad8 req-803f1528-2a52-4033-8b4f-4f72b502e699 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052778 Feb 19 05:03:19.270170 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 235/482] 10.222.0.47 () {64 vars in 1308 bytes} [Fri Feb 19 05:03:19 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 05:03:19.277228 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-81be2abd-c0c1-4cbc-867a-4dce428def90 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:03:19.277974 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-81be2abd-c0c1-4cbc-867a-4dce428def90 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] [instance: 74c5a115-b174-49fe-9b75-574e484a09e2] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:03:19.288695 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-81be2abd-c0c1-4cbc-867a-4dce428def90 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:19.289213 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-81be2abd-c0c1-4cbc-867a-4dce428def90 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:19.290100 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-81be2abd-c0c1-4cbc-867a-4dce428def90 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:19.290600 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-81be2abd-c0c1-4cbc-867a-4dce428def90 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:19.317029 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-daf13722-1fed-4019-9821-5ee352111468 tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] 10.222.0.47 "DELETE /compute/v2.1/servers/0d55dde2-c4d7-4da3-9f14-2e6a30f69bcb/os-volume_attachments/59b74bfb-ca28-4986-a8e7-eed98d56db9f" status: 202 len: 0 microversion: 2.1 time: 0.620852 Feb 19 05:03:19.318030 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 248/483] 10.222.0.47 () {58 vars in 1406 bytes} [Fri Feb 19 05:03:18 2021] DELETE /compute/v2.1/servers/0d55dde2-c4d7-4da3-9f14-2e6a30f69bcb/os-volume_attachments/59b74bfb-ca28-4986-a8e7-eed98d56db9f => generated 0 bytes in 627 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 19 05:03:19.405664 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-5fdeb24c-71a2-4509-b608-de26b617d835 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:03:19.406491 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-5fdeb24c-71a2-4509-b608-de26b617d835 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] [instance: 798b77ff-c3ca-4c65-a120-db12ad953621] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:03:19.426080 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-5fdeb24c-71a2-4509-b608-de26b617d835 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:19.426597 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-5fdeb24c-71a2-4509-b608-de26b617d835 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:19.427627 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-5fdeb24c-71a2-4509-b608-de26b617d835 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:19.436226 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-5fdeb24c-71a2-4509-b608-de26b617d835 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:19.697696 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.wsgi [None req-81be2abd-c0c1-4cbc-867a-4dce428def90 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] HTTP exception thrown: Cannot 'detach_volume' instance 74c5a115-b174-49fe-9b75-574e484a09e2 while it is in vm_state rescued Feb 19 05:03:19.698750 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-81be2abd-c0c1-4cbc-867a-4dce428def90 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Returning 409 to user: Cannot 'detach_volume' instance 74c5a115-b174-49fe-9b75-574e484a09e2 while it is in vm_state rescued {{(pid=98153) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 19 05:03:19.701173 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-81be2abd-c0c1-4cbc-867a-4dce428def90 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] 10.222.0.47 "DELETE /compute/v2.1/servers/74c5a115-b174-49fe-9b75-574e484a09e2/os-volume_attachments/dfeaee6c-a0ad-4a23-ad13-73f31fa31f1c" status: 409 len: 152 microversion: 2.1 time: 0.429311 Feb 19 05:03:19.701966 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 236/484] 10.222.0.47 () {58 vars in 1406 bytes} [Fri Feb 19 05:03:19 2021] DELETE /compute/v2.1/servers/74c5a115-b174-49fe-9b75-574e484a09e2/os-volume_attachments/dfeaee6c-a0ad-4a23-ad13-73f31fa31f1c => generated 152 bytes in 432 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Feb 19 05:03:19.707881 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-f2a705f3-f3ff-47b3-a5c9-bad5fd7a8620 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:03:19.709272 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-f2a705f3-f3ff-47b3-a5c9-bad5fd7a8620 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] [instance: d49e68e7-1b06-45d5-b811-440fe0435ed4] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:03:19.726578 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-f2a705f3-f3ff-47b3-a5c9-bad5fd7a8620 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:19.727087 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-f2a705f3-f3ff-47b3-a5c9-bad5fd7a8620 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:19.728099 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-f2a705f3-f3ff-47b3-a5c9-bad5fd7a8620 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:19.728599 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-f2a705f3-f3ff-47b3-a5c9-bad5fd7a8620 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:19.821098 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-f2a705f3-f3ff-47b3-a5c9-bad5fd7a8620 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:19.822598 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-f2a705f3-f3ff-47b3-a5c9-bad5fd7a8620 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:19.823293 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.objects.instance [None req-f2a705f3-f3ff-47b3-a5c9-bad5fd7a8620 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lazy-loading 'fault' on Instance uuid d49e68e7-1b06-45d5-b811-440fe0435ed4 {{(pid=98153) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Feb 19 05:03:20.088791 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-f2a705f3-f3ff-47b3-a5c9-bad5fd7a8620 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628d846121a14be78329ccc727c8869d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa473e12960449bbb0713a709e0abe4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:03:20.117668 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-f2a705f3-f3ff-47b3-a5c9-bad5fd7a8620 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] 10.222.0.47 "GET /compute/v2.1/servers/d49e68e7-1b06-45d5-b811-440fe0435ed4" status: 200 len: 1308 microversion: 2.1 time: 0.414131 Feb 19 05:03:20.128767 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 237/485] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:03:19 2021] GET /compute/v2.1/servers/d49e68e7-1b06-45d5-b811-440fe0435ed4 => generated 1308 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:03:20.147262 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-4596bfe0-48be-4b0e-9deb-9fc10c2f953f tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:03:20.147911 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-4596bfe0-48be-4b0e-9deb-9fc10c2f953f tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] [instance: 74c5a115-b174-49fe-9b75-574e484a09e2] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:03:20.170497 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-4596bfe0-48be-4b0e-9deb-9fc10c2f953f tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:20.172219 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-4596bfe0-48be-4b0e-9deb-9fc10c2f953f tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:20.173545 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-4596bfe0-48be-4b0e-9deb-9fc10c2f953f tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:20.175018 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-4596bfe0-48be-4b0e-9deb-9fc10c2f953f tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:20.563130 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-4596bfe0-48be-4b0e-9deb-9fc10c2f953f tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] 10.222.0.47 "POST /compute/v2.1/servers/74c5a115-b174-49fe-9b75-574e484a09e2/action" status: 202 len: 0 microversion: 2.1 time: 0.423205 Feb 19 05:03:20.563890 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 238/486] 10.222.0.47 () {60 vars in 1268 bytes} [Fri Feb 19 05:03:20 2021] POST /compute/v2.1/servers/74c5a115-b174-49fe-9b75-574e484a09e2/action => generated 0 bytes in 435 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 19 05:03:20.585365 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-27b77d61-91fd-4c3b-9119-39c84ae1e329 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:03:20.590429 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-27b77d61-91fd-4c3b-9119-39c84ae1e329 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] [instance: 74c5a115-b174-49fe-9b75-574e484a09e2] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:03:20.607653 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-27b77d61-91fd-4c3b-9119-39c84ae1e329 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:20.608642 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-27b77d61-91fd-4c3b-9119-39c84ae1e329 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:20.623997 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-27b77d61-91fd-4c3b-9119-39c84ae1e329 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:20.627796 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-27b77d61-91fd-4c3b-9119-39c84ae1e329 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:20.756799 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-5fdeb24c-71a2-4509-b608-de26b617d835 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:03:20.814345 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-5fdeb24c-71a2-4509-b608-de26b617d835 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:03:20.837348 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-5fdeb24c-71a2-4509-b608-de26b617d835 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:03:20.840943 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-5fdeb24c-71a2-4509-b608-de26b617d835 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] 10.222.0.47 "GET /compute/v2.1/servers/798b77ff-c3ca-4c65-a120-db12ad953621" status: 200 len: 1810 microversion: 2.20 time: 1.441592 Feb 19 05:03:20.842507 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 249/487] 10.222.0.47 () {60 vars in 1267 bytes} [Fri Feb 19 05:03:19 2021] GET /compute/v2.1/servers/798b77ff-c3ca-4c65-a120-db12ad953621 => generated 1810 bytes in 1445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 19 05:03:21.151990 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-12600236-8d98-49ef-bb70-c0fe13929208 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:03:21.152966 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-12600236-8d98-49ef-bb70-c0fe13929208 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] [instance: d49e68e7-1b06-45d5-b811-440fe0435ed4] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:03:21.181547 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-12600236-8d98-49ef-bb70-c0fe13929208 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:21.182032 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-12600236-8d98-49ef-bb70-c0fe13929208 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:21.182924 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-12600236-8d98-49ef-bb70-c0fe13929208 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:21.189506 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-12600236-8d98-49ef-bb70-c0fe13929208 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:21.322355 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.wsgi [None req-12600236-8d98-49ef-bb70-c0fe13929208 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] HTTP exception thrown: Instance d49e68e7-1b06-45d5-b811-440fe0435ed4 could not be found. Feb 19 05:03:21.322355 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-12600236-8d98-49ef-bb70-c0fe13929208 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Returning 404 to user: Instance d49e68e7-1b06-45d5-b811-440fe0435ed4 could not be found. {{(pid=98154) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 19 05:03:21.322788 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-12600236-8d98-49ef-bb70-c0fe13929208 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] 10.222.0.47 "GET /compute/v2.1/servers/d49e68e7-1b06-45d5-b811-440fe0435ed4" status: 404 len: 111 microversion: 2.1 time: 0.176630 Feb 19 05:03:21.323743 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 250/488] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:03:21 2021] GET /compute/v2.1/servers/d49e68e7-1b06-45d5-b811-440fe0435ed4 => generated 111 bytes in 179 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 05:03:21.348419 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-27b77d61-91fd-4c3b-9119-39c84ae1e329 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24af0562e2aa43ca9d601be5e16fe9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ee9a43087d5497da3af9fbf68c4572d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:03:21.369219 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-27b77d61-91fd-4c3b-9119-39c84ae1e329 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] 10.222.0.47 "GET /compute/v2.1/servers/74c5a115-b174-49fe-9b75-574e484a09e2" status: 200 len: 1553 microversion: 2.1 time: 0.797004 Feb 19 05:03:21.387386 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 239/489] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:03:20 2021] GET /compute/v2.1/servers/74c5a115-b174-49fe-9b75-574e484a09e2 => generated 1553 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:03:21.872355 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-76f56564-8265-4347-8b40-0a569de31d8f tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:03:21.874338 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-76f56564-8265-4347-8b40-0a569de31d8f tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] [instance: 798b77ff-c3ca-4c65-a120-db12ad953621] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:03:21.897657 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-76f56564-8265-4347-8b40-0a569de31d8f tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:21.900496 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-76f56564-8265-4347-8b40-0a569de31d8f tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:21.902848 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-76f56564-8265-4347-8b40-0a569de31d8f tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:21.905223 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-76f56564-8265-4347-8b40-0a569de31d8f tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:22.435759 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-69d7d04a-3193-4f14-8210-68aad582cb64 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:03:22.443642 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-69d7d04a-3193-4f14-8210-68aad582cb64 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] [instance: 74c5a115-b174-49fe-9b75-574e484a09e2] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:03:22.479103 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-69d7d04a-3193-4f14-8210-68aad582cb64 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:22.482172 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-69d7d04a-3193-4f14-8210-68aad582cb64 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:22.484855 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-69d7d04a-3193-4f14-8210-68aad582cb64 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:22.486503 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-69d7d04a-3193-4f14-8210-68aad582cb64 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:22.601710 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-76f56564-8265-4347-8b40-0a569de31d8f tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:03:22.634952 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-76f56564-8265-4347-8b40-0a569de31d8f tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:03:22.636934 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-76f56564-8265-4347-8b40-0a569de31d8f tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:03:22.638458 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-76f56564-8265-4347-8b40-0a569de31d8f tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] 10.222.0.47 "GET /compute/v2.1/servers/798b77ff-c3ca-4c65-a120-db12ad953621" status: 200 len: 1810 microversion: 2.20 time: 0.770684 Feb 19 05:03:22.650623 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 251/490] 10.222.0.47 () {60 vars in 1267 bytes} [Fri Feb 19 05:03:21 2021] GET /compute/v2.1/servers/798b77ff-c3ca-4c65-a120-db12ad953621 => generated 1810 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 05:03:22.996114 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-70949a2d-dabb-4a32-bc6e-840b79f60597 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:03:22.997975 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-70949a2d-dabb-4a32-bc6e-840b79f60597 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] [instance: 3aafde29-2f77-4921-9580-05730dd73604] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:03:23.019172 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-70949a2d-dabb-4a32-bc6e-840b79f60597 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:23.021002 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-70949a2d-dabb-4a32-bc6e-840b79f60597 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:23.023059 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-70949a2d-dabb-4a32-bc6e-840b79f60597 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:23.024593 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-70949a2d-dabb-4a32-bc6e-840b79f60597 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:23.037295 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-69d7d04a-3193-4f14-8210-68aad582cb64 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24af0562e2aa43ca9d601be5e16fe9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ee9a43087d5497da3af9fbf68c4572d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:03:23.061792 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-69d7d04a-3193-4f14-8210-68aad582cb64 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] 10.222.0.47 "GET /compute/v2.1/servers/74c5a115-b174-49fe-9b75-574e484a09e2" status: 200 len: 1553 microversion: 2.1 time: 0.662722 Feb 19 05:03:23.070257 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 240/491] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:03:22 2021] GET /compute/v2.1/servers/74c5a115-b174-49fe-9b75-574e484a09e2 => generated 1553 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:03:23.176180 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-70949a2d-dabb-4a32-bc6e-840b79f60597 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] [instance: 3aafde29-2f77-4921-9580-05730dd73604] Going to try to terminate instance {{(pid=98154) delete /opt/stack/nova/nova/compute/api.py:2540}} Feb 19 05:03:23.413131 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-70949a2d-dabb-4a32-bc6e-840b79f60597 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] 10.222.0.47 "DELETE /compute/v2.1/servers/3aafde29-2f77-4921-9580-05730dd73604" status: 204 len: 0 microversion: 2.1 time: 0.425675 Feb 19 05:03:23.414625 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 252/492] 10.222.0.47 () {58 vars in 1229 bytes} [Fri Feb 19 05:03:22 2021] DELETE /compute/v2.1/servers/3aafde29-2f77-4921-9580-05730dd73604 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 19 05:03:23.425341 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-8eeb4630-be65-4f89-b9db-791cd52ee45b tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:03:23.426440 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-8eeb4630-be65-4f89-b9db-791cd52ee45b tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] [instance: 3aafde29-2f77-4921-9580-05730dd73604] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:03:23.444181 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-8eeb4630-be65-4f89-b9db-791cd52ee45b tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:23.444697 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-8eeb4630-be65-4f89-b9db-791cd52ee45b tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:23.445585 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-8eeb4630-be65-4f89-b9db-791cd52ee45b tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:23.446083 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-8eeb4630-be65-4f89-b9db-791cd52ee45b tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:23.665263 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-558afbca-3428-45f1-82df-2173855e3035 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:03:23.666073 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-558afbca-3428-45f1-82df-2173855e3035 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] [instance: 798b77ff-c3ca-4c65-a120-db12ad953621] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:03:23.696773 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-558afbca-3428-45f1-82df-2173855e3035 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:23.699928 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-558afbca-3428-45f1-82df-2173855e3035 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:23.701757 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-558afbca-3428-45f1-82df-2173855e3035 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:23.702677 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-558afbca-3428-45f1-82df-2173855e3035 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:24.155965 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-8eeb4630-be65-4f89-b9db-791cd52ee45b tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628d846121a14be78329ccc727c8869d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa473e12960449bbb0713a709e0abe4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:03:24.172377 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-8eeb4630-be65-4f89-b9db-791cd52ee45b tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] 10.222.0.47 "GET /compute/v2.1/servers/3aafde29-2f77-4921-9580-05730dd73604" status: 200 len: 1515 microversion: 2.1 time: 0.752715 Feb 19 05:03:24.173619 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 241/493] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:03:23 2021] GET /compute/v2.1/servers/3aafde29-2f77-4921-9580-05730dd73604 => generated 1515 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:03:24.196475 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-007d3281-481d-46b9-a29d-4e83c442b9c1 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:03:24.197275 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-007d3281-481d-46b9-a29d-4e83c442b9c1 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] [instance: 74c5a115-b174-49fe-9b75-574e484a09e2] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:03:24.208639 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-007d3281-481d-46b9-a29d-4e83c442b9c1 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:24.210044 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-007d3281-481d-46b9-a29d-4e83c442b9c1 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:24.211439 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-007d3281-481d-46b9-a29d-4e83c442b9c1 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:24.212043 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-007d3281-481d-46b9-a29d-4e83c442b9c1 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:24.390438 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-558afbca-3428-45f1-82df-2173855e3035 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:03:24.411622 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-558afbca-3428-45f1-82df-2173855e3035 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:03:24.413668 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-558afbca-3428-45f1-82df-2173855e3035 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:03:24.415940 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-558afbca-3428-45f1-82df-2173855e3035 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] 10.222.0.47 "GET /compute/v2.1/servers/798b77ff-c3ca-4c65-a120-db12ad953621" status: 200 len: 1810 microversion: 2.20 time: 0.759693 Feb 19 05:03:24.419391 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 253/494] 10.222.0.47 () {60 vars in 1267 bytes} [Fri Feb 19 05:03:23 2021] GET /compute/v2.1/servers/798b77ff-c3ca-4c65-a120-db12ad953621 => generated 1810 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 05:03:24.558913 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-007d3281-481d-46b9-a29d-4e83c442b9c1 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24af0562e2aa43ca9d601be5e16fe9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ee9a43087d5497da3af9fbf68c4572d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:03:24.569310 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-007d3281-481d-46b9-a29d-4e83c442b9c1 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] 10.222.0.47 "GET /compute/v2.1/servers/74c5a115-b174-49fe-9b75-574e484a09e2" status: 200 len: 1553 microversion: 2.1 time: 0.381015 Feb 19 05:03:24.570056 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 242/495] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:03:24 2021] GET /compute/v2.1/servers/74c5a115-b174-49fe-9b75-574e484a09e2 => generated 1553 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:03:25.039936 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-b0a741ec-fec3-4855-b73a-241d53b89a81 tempest-VolumesNegativeTest-1028193160 tempest-VolumesNegativeTest-1028193160-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-175965108", "imageRef": "53cdf9de-e495-4ca8-845f-6be2bf32cecb", "flavorRef": "452"}} {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:03:25.129051 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.network.neutron [None req-b0a741ec-fec3-4855-b73a-241d53b89a81 tempest-VolumesNegativeTest-1028193160 tempest-VolumesNegativeTest-1028193160-project] validate_networks() for None {{(pid=98154) validate_networks /opt/stack/nova/nova/network/neutron.py:2345}} Feb 19 05:03:25.206653 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-ece1a8bd-2425-40b9-8c76-8242848f3643 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:03:25.208620 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-ece1a8bd-2425-40b9-8c76-8242848f3643 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] [instance: 3aafde29-2f77-4921-9580-05730dd73604] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:03:25.226569 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-ece1a8bd-2425-40b9-8c76-8242848f3643 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:25.227511 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-ece1a8bd-2425-40b9-8c76-8242848f3643 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:25.228607 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-ece1a8bd-2425-40b9-8c76-8242848f3643 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:25.229298 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-ece1a8bd-2425-40b9-8c76-8242848f3643 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:25.546256 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.virt.hardware [None req-b0a741ec-fec3-4855-b73a-241d53b89a81 tempest-VolumesNegativeTest-1028193160 tempest-VolumesNegativeTest-1028193160-project] Flavor limits 0:0:0 {{(pid=98154) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 19 05:03:25.547696 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.virt.hardware [None req-b0a741ec-fec3-4855-b73a-241d53b89a81 tempest-VolumesNegativeTest-1028193160 tempest-VolumesNegativeTest-1028193160-project] Image limits 0:0:0 {{(pid=98154) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Feb 19 05:03:25.549185 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.virt.hardware [None req-b0a741ec-fec3-4855-b73a-241d53b89a81 tempest-VolumesNegativeTest-1028193160 tempest-VolumesNegativeTest-1028193160-project] Flavor pref 0:0:0 {{(pid=98154) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 19 05:03:25.550377 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.virt.hardware [None req-b0a741ec-fec3-4855-b73a-241d53b89a81 tempest-VolumesNegativeTest-1028193160 tempest-VolumesNegativeTest-1028193160-project] Image pref 0:0:0 {{(pid=98154) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Feb 19 05:03:25.551824 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.virt.hardware [None req-b0a741ec-fec3-4855-b73a-241d53b89a81 tempest-VolumesNegativeTest-1028193160 tempest-VolumesNegativeTest-1028193160-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98154) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Feb 19 05:03:25.566757 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-b0a741ec-fec3-4855-b73a-241d53b89a81 tempest-VolumesNegativeTest-1028193160 tempest-VolumesNegativeTest-1028193160-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:25.569136 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-b0a741ec-fec3-4855-b73a-241d53b89a81 tempest-VolumesNegativeTest-1028193160 tempest-VolumesNegativeTest-1028193160-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:25.570968 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-b0a741ec-fec3-4855-b73a-241d53b89a81 tempest-VolumesNegativeTest-1028193160 tempest-VolumesNegativeTest-1028193160-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:25.573053 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-b0a741ec-fec3-4855-b73a-241d53b89a81 tempest-VolumesNegativeTest-1028193160 tempest-VolumesNegativeTest-1028193160-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:25.619487 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-ece1a8bd-2425-40b9-8c76-8242848f3643 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628d846121a14be78329ccc727c8869d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa473e12960449bbb0713a709e0abe4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:03:25.638287 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-ece1a8bd-2425-40b9-8c76-8242848f3643 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] 10.222.0.47 "GET /compute/v2.1/servers/3aafde29-2f77-4921-9580-05730dd73604" status: 200 len: 1515 microversion: 2.1 time: 0.438965 Feb 19 05:03:25.647712 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.quota [None req-b0a741ec-fec3-4855-b73a-241d53b89a81 tempest-VolumesNegativeTest-1028193160 tempest-VolumesNegativeTest-1028193160-project] Getting quotas for project 867df4a337884f3ba55b96cae97c9dd6. Resources: {'instances', 'ram', 'cores'} {{(pid=98154) _get_quotas /opt/stack/nova/nova/quota.py:388}} Feb 19 05:03:25.650551 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 243/496] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:03:25 2021] GET /compute/v2.1/servers/3aafde29-2f77-4921-9580-05730dd73604 => generated 1515 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 05:03:25.655930 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-07b78f76-7994-4995-bfcb-f94c7e6fefd5 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:03:25.656624 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-07b78f76-7994-4995-bfcb-f94c7e6fefd5 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] [instance: 798b77ff-c3ca-4c65-a120-db12ad953621] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:03:25.665658 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-07b78f76-7994-4995-bfcb-f94c7e6fefd5 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:25.666160 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-07b78f76-7994-4995-bfcb-f94c7e6fefd5 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:25.667031 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-07b78f76-7994-4995-bfcb-f94c7e6fefd5 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:25.667586 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-07b78f76-7994-4995-bfcb-f94c7e6fefd5 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:25.671649 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.quota [None req-b0a741ec-fec3-4855-b73a-241d53b89a81 tempest-VolumesNegativeTest-1028193160 tempest-VolumesNegativeTest-1028193160-project] Getting quotas for user 46771ec6b0af4283b16eadaa4c81a97e and project 867df4a337884f3ba55b96cae97c9dd6. Resources: {'instances', 'ram', 'cores'} {{(pid=98154) _get_quotas /opt/stack/nova/nova/quota.py:380}} Feb 19 05:03:25.707972 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-b0a741ec-fec3-4855-b73a-241d53b89a81 tempest-VolumesNegativeTest-1028193160 tempest-VolumesNegativeTest-1028193160-project] Going to run 1 instances... {{(pid=98154) _provision_instances /opt/stack/nova/nova/compute/api.py:1264}} Feb 19 05:03:25.712154 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-b0a741ec-fec3-4855-b73a-241d53b89a81 tempest-VolumesNegativeTest-1028193160 tempest-VolumesNegativeTest-1028193160-project] [instance: 3d02af20-1c93-4a68-a24d-8685406d9eb1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='53cdf9de-e495-4ca8-845f-6be2bf32cecb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98154) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1666}} Feb 19 05:03:25.812983 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-b0a741ec-fec3-4855-b73a-241d53b89a81 tempest-VolumesNegativeTest-1028193160 tempest-VolumesNegativeTest-1028193160-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.777437 Feb 19 05:03:25.816747 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 254/497] 10.222.0.47 () {60 vars in 1137 bytes} [Fri Feb 19 05:03:25 2021] POST /compute/v2.1/servers => generated 380 bytes in 782 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 19 05:03:25.828356 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-57ad7dbd-265c-417a-8074-a975d80bc6ca tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:03:25.829552 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-57ad7dbd-265c-417a-8074-a975d80bc6ca tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] [instance: 74c5a115-b174-49fe-9b75-574e484a09e2] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:03:25.850011 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-57ad7dbd-265c-417a-8074-a975d80bc6ca tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:25.850512 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-57ad7dbd-265c-417a-8074-a975d80bc6ca tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:25.862923 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-57ad7dbd-265c-417a-8074-a975d80bc6ca tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:25.863473 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-57ad7dbd-265c-417a-8074-a975d80bc6ca tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:26.925199 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-07b78f76-7994-4995-bfcb-f94c7e6fefd5 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:03:26.960844 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-07b78f76-7994-4995-bfcb-f94c7e6fefd5 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:03:26.965575 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-07b78f76-7994-4995-bfcb-f94c7e6fefd5 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:03:26.969402 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-07b78f76-7994-4995-bfcb-f94c7e6fefd5 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] 10.222.0.47 "GET /compute/v2.1/servers/798b77ff-c3ca-4c65-a120-db12ad953621" status: 200 len: 1810 microversion: 2.20 time: 1.316916 Feb 19 05:03:26.971172 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 244/498] 10.222.0.47 () {60 vars in 1267 bytes} [Fri Feb 19 05:03:25 2021] GET /compute/v2.1/servers/798b77ff-c3ca-4c65-a120-db12ad953621 => generated 1810 bytes in 1320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 05:03:27.004357 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-57ad7dbd-265c-417a-8074-a975d80bc6ca tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24af0562e2aa43ca9d601be5e16fe9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ee9a43087d5497da3af9fbf68c4572d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:03:27.004711 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-cab63641-6d54-4758-ba72-a3c76c813147 tempest-VolumesNegativeTest-1028193160 tempest-VolumesNegativeTest-1028193160-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:03:27.007721 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-cab63641-6d54-4758-ba72-a3c76c813147 tempest-VolumesNegativeTest-1028193160 tempest-VolumesNegativeTest-1028193160-project] [instance: 3d02af20-1c93-4a68-a24d-8685406d9eb1] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:03:27.020052 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-57ad7dbd-265c-417a-8074-a975d80bc6ca tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] 10.222.0.47 "GET /compute/v2.1/servers/74c5a115-b174-49fe-9b75-574e484a09e2" status: 200 len: 1553 microversion: 2.1 time: 1.202003 Feb 19 05:03:27.026854 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-cab63641-6d54-4758-ba72-a3c76c813147 tempest-VolumesNegativeTest-1028193160 tempest-VolumesNegativeTest-1028193160-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:27.027825 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 255/499] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:03:25 2021] GET /compute/v2.1/servers/74c5a115-b174-49fe-9b75-574e484a09e2 => generated 1553 bytes in 1210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:03:27.028971 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-cab63641-6d54-4758-ba72-a3c76c813147 tempest-VolumesNegativeTest-1028193160 tempest-VolumesNegativeTest-1028193160-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:27.030931 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-cab63641-6d54-4758-ba72-a3c76c813147 tempest-VolumesNegativeTest-1028193160 tempest-VolumesNegativeTest-1028193160-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:27.032146 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-cab63641-6d54-4758-ba72-a3c76c813147 tempest-VolumesNegativeTest-1028193160 tempest-VolumesNegativeTest-1028193160-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:27.038338 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-e6d2ab20-0a11-4016-81f0-c5f82bb078e5 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:03:27.039194 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-e6d2ab20-0a11-4016-81f0-c5f82bb078e5 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] [instance: 3aafde29-2f77-4921-9580-05730dd73604] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:03:27.060015 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-e6d2ab20-0a11-4016-81f0-c5f82bb078e5 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:27.060674 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-e6d2ab20-0a11-4016-81f0-c5f82bb078e5 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:27.061719 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-e6d2ab20-0a11-4016-81f0-c5f82bb078e5 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:27.062218 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-e6d2ab20-0a11-4016-81f0-c5f82bb078e5 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:27.370285 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-cab63641-6d54-4758-ba72-a3c76c813147 tempest-VolumesNegativeTest-1028193160 tempest-VolumesNegativeTest-1028193160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46771ec6b0af4283b16eadaa4c81a97e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '867df4a337884f3ba55b96cae97c9dd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:03:27.390031 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-cab63641-6d54-4758-ba72-a3c76c813147 tempest-VolumesNegativeTest-1028193160 tempest-VolumesNegativeTest-1028193160-project] 10.222.0.47 "GET /compute/v2.1/servers/3d02af20-1c93-4a68-a24d-8685406d9eb1" status: 200 len: 1218 microversion: 2.1 time: 0.403312 Feb 19 05:03:27.391710 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 245/500] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:03:26 2021] GET /compute/v2.1/servers/3d02af20-1c93-4a68-a24d-8685406d9eb1 => generated 1218 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:03:27.669834 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-e6d2ab20-0a11-4016-81f0-c5f82bb078e5 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628d846121a14be78329ccc727c8869d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa473e12960449bbb0713a709e0abe4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:03:27.691919 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-e6d2ab20-0a11-4016-81f0-c5f82bb078e5 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] 10.222.0.47 "GET /compute/v2.1/servers/3aafde29-2f77-4921-9580-05730dd73604" status: 200 len: 1515 microversion: 2.1 time: 0.662624 Feb 19 05:03:27.692552 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 256/501] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:03:27 2021] GET /compute/v2.1/servers/3aafde29-2f77-4921-9580-05730dd73604 => generated 1515 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:03:28.016373 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-2c491aab-dff0-4290-91e4-5b9b10b26181 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:03:28.026541 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-2c491aab-dff0-4290-91e4-5b9b10b26181 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] [instance: 798b77ff-c3ca-4c65-a120-db12ad953621] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:03:28.069186 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-3f6edbc7-cda8-43b1-91a4-4852a810b793 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:03:28.082405 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-3f6edbc7-cda8-43b1-91a4-4852a810b793 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] [instance: 74c5a115-b174-49fe-9b75-574e484a09e2] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:03:28.104069 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-2c491aab-dff0-4290-91e4-5b9b10b26181 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:28.112824 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-2c491aab-dff0-4290-91e4-5b9b10b26181 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:28.115033 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-2c491aab-dff0-4290-91e4-5b9b10b26181 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:28.119699 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-2c491aab-dff0-4290-91e4-5b9b10b26181 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:28.155103 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-3f6edbc7-cda8-43b1-91a4-4852a810b793 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:28.155989 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-3f6edbc7-cda8-43b1-91a4-4852a810b793 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:28.158211 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-3f6edbc7-cda8-43b1-91a4-4852a810b793 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:28.159059 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-3f6edbc7-cda8-43b1-91a4-4852a810b793 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:28.380384 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 19 05:03:28.385819 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: Fri Feb 19 05:03:28 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/798b77ff-c3ca-4c65-a120-db12ad953621 (ip 10.222.0.47) !!! Feb 19 05:03:29.483870 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-2c491aab-dff0-4290-91e4-5b9b10b26181 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:03:29.529761 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-2c491aab-dff0-4290-91e4-5b9b10b26181 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:03:29.535221 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-2c491aab-dff0-4290-91e4-5b9b10b26181 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:03:29.537773 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-2c491aab-dff0-4290-91e4-5b9b10b26181 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] 10.222.0.47 "GET /compute/v2.1/servers/798b77ff-c3ca-4c65-a120-db12ad953621" status: 200 len: 1810 microversion: 2.20 time: 1.537467 Feb 19 05:03:29.569288 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 246/502] 10.222.0.47 () {60 vars in 1267 bytes} [Fri Feb 19 05:03:27 2021] GET /compute/v2.1/servers/798b77ff-c3ca-4c65-a120-db12ad953621 => generated 1810 bytes in 1570 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 05:03:29.577537 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-6917d81d-958e-4239-b30c-9d0f2259e15e tempest-VolumesNegativeTest-1028193160 tempest-VolumesNegativeTest-1028193160-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:03:29.579313 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-6917d81d-958e-4239-b30c-9d0f2259e15e tempest-VolumesNegativeTest-1028193160 tempest-VolumesNegativeTest-1028193160-project] [instance: 3d02af20-1c93-4a68-a24d-8685406d9eb1] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:03:29.607831 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-3f6edbc7-cda8-43b1-91a4-4852a810b793 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24af0562e2aa43ca9d601be5e16fe9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ee9a43087d5497da3af9fbf68c4572d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:03:29.625226 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-6917d81d-958e-4239-b30c-9d0f2259e15e tempest-VolumesNegativeTest-1028193160 tempest-VolumesNegativeTest-1028193160-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:29.627430 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-6917d81d-958e-4239-b30c-9d0f2259e15e tempest-VolumesNegativeTest-1028193160 tempest-VolumesNegativeTest-1028193160-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:29.629054 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-6917d81d-958e-4239-b30c-9d0f2259e15e tempest-VolumesNegativeTest-1028193160 tempest-VolumesNegativeTest-1028193160-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:29.629986 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-6917d81d-958e-4239-b30c-9d0f2259e15e tempest-VolumesNegativeTest-1028193160 tempest-VolumesNegativeTest-1028193160-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:29.656979 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-3f6edbc7-cda8-43b1-91a4-4852a810b793 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] 10.222.0.47 "GET /compute/v2.1/servers/74c5a115-b174-49fe-9b75-574e484a09e2" status: 200 len: 1553 microversion: 2.1 time: 1.599335 Feb 19 05:03:29.658660 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 257/503] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:03:28 2021] GET /compute/v2.1/servers/74c5a115-b174-49fe-9b75-574e484a09e2 => generated 1553 bytes in 1604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:03:29.707776 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-171d0a59-f60a-4e36-826c-08ced0aba969 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:03:29.721840 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-171d0a59-f60a-4e36-826c-08ced0aba969 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] [instance: 3aafde29-2f77-4921-9580-05730dd73604] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:03:29.761548 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-171d0a59-f60a-4e36-826c-08ced0aba969 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:29.767377 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-171d0a59-f60a-4e36-826c-08ced0aba969 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:29.769406 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-171d0a59-f60a-4e36-826c-08ced0aba969 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:29.777005 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-171d0a59-f60a-4e36-826c-08ced0aba969 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:30.435085 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-6917d81d-958e-4239-b30c-9d0f2259e15e tempest-VolumesNegativeTest-1028193160 tempest-VolumesNegativeTest-1028193160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46771ec6b0af4283b16eadaa4c81a97e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '867df4a337884f3ba55b96cae97c9dd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:03:30.455384 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-6917d81d-958e-4239-b30c-9d0f2259e15e tempest-VolumesNegativeTest-1028193160 tempest-VolumesNegativeTest-1028193160-project] 10.222.0.47 "GET /compute/v2.1/servers/3d02af20-1c93-4a68-a24d-8685406d9eb1" status: 200 len: 1218 microversion: 2.1 time: 0.884149 Feb 19 05:03:30.456888 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 247/504] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:03:29 2021] GET /compute/v2.1/servers/3d02af20-1c93-4a68-a24d-8685406d9eb1 => generated 1218 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:03:30.572505 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-1ee7ddbb-74cf-418c-a90c-37ca1f64ae63 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:03:30.573172 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-1ee7ddbb-74cf-418c-a90c-37ca1f64ae63 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] [instance: 798b77ff-c3ca-4c65-a120-db12ad953621] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:03:30.583602 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-1ee7ddbb-74cf-418c-a90c-37ca1f64ae63 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:30.584114 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-1ee7ddbb-74cf-418c-a90c-37ca1f64ae63 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:30.584974 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-1ee7ddbb-74cf-418c-a90c-37ca1f64ae63 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:30.585502 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-1ee7ddbb-74cf-418c-a90c-37ca1f64ae63 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:30.874053 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-171d0a59-f60a-4e36-826c-08ced0aba969 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628d846121a14be78329ccc727c8869d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa473e12960449bbb0713a709e0abe4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:03:30.893325 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-171d0a59-f60a-4e36-826c-08ced0aba969 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] 10.222.0.47 "GET /compute/v2.1/servers/3aafde29-2f77-4921-9580-05730dd73604" status: 200 len: 1515 microversion: 2.1 time: 1.232123 Feb 19 05:03:30.896003 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 258/505] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:03:29 2021] GET /compute/v2.1/servers/3aafde29-2f77-4921-9580-05730dd73604 => generated 1515 bytes in 1236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:03:30.929243 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-4042422b-aea5-4558-bd4f-b511af0a1cb7 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:03:30.929243 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-4042422b-aea5-4558-bd4f-b511af0a1cb7 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] [instance: 74c5a115-b174-49fe-9b75-574e484a09e2] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:03:30.938639 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-4042422b-aea5-4558-bd4f-b511af0a1cb7 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:30.938967 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-4042422b-aea5-4558-bd4f-b511af0a1cb7 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:30.940095 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-4042422b-aea5-4558-bd4f-b511af0a1cb7 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:30.940602 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-4042422b-aea5-4558-bd4f-b511af0a1cb7 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:31.323887 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-1ee7ddbb-74cf-418c-a90c-37ca1f64ae63 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:03:31.343772 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-1ee7ddbb-74cf-418c-a90c-37ca1f64ae63 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:03:31.347934 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-1ee7ddbb-74cf-418c-a90c-37ca1f64ae63 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:03:31.350353 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-1ee7ddbb-74cf-418c-a90c-37ca1f64ae63 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] 10.222.0.47 "GET /compute/v2.1/servers/798b77ff-c3ca-4c65-a120-db12ad953621" status: 200 len: 1810 microversion: 2.20 time: 0.783736 Feb 19 05:03:31.351546 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 248/506] 10.222.0.47 () {60 vars in 1267 bytes} [Fri Feb 19 05:03:30 2021] GET /compute/v2.1/servers/798b77ff-c3ca-4c65-a120-db12ad953621 => generated 1810 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 05:03:31.475661 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-fbf39e92-d0f9-41ba-a6f1-5ce97249299b tempest-VolumesNegativeTest-1028193160 tempest-VolumesNegativeTest-1028193160-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:03:31.476351 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-fbf39e92-d0f9-41ba-a6f1-5ce97249299b tempest-VolumesNegativeTest-1028193160 tempest-VolumesNegativeTest-1028193160-project] [instance: 3d02af20-1c93-4a68-a24d-8685406d9eb1] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:03:31.488554 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-fbf39e92-d0f9-41ba-a6f1-5ce97249299b tempest-VolumesNegativeTest-1028193160 tempest-VolumesNegativeTest-1028193160-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:31.489292 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-fbf39e92-d0f9-41ba-a6f1-5ce97249299b tempest-VolumesNegativeTest-1028193160 tempest-VolumesNegativeTest-1028193160-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:31.490487 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-fbf39e92-d0f9-41ba-a6f1-5ce97249299b tempest-VolumesNegativeTest-1028193160 tempest-VolumesNegativeTest-1028193160-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:31.491140 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-fbf39e92-d0f9-41ba-a6f1-5ce97249299b tempest-VolumesNegativeTest-1028193160 tempest-VolumesNegativeTest-1028193160-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:31.504166 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-4042422b-aea5-4558-bd4f-b511af0a1cb7 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24af0562e2aa43ca9d601be5e16fe9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ee9a43087d5497da3af9fbf68c4572d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:03:31.517146 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-4042422b-aea5-4558-bd4f-b511af0a1cb7 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] 10.222.0.47 "GET /compute/v2.1/servers/74c5a115-b174-49fe-9b75-574e484a09e2" status: 200 len: 1553 microversion: 2.1 time: 0.593585 Feb 19 05:03:31.518211 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 259/507] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:03:30 2021] GET /compute/v2.1/servers/74c5a115-b174-49fe-9b75-574e484a09e2 => generated 1553 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:03:31.646127 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-fbf39e92-d0f9-41ba-a6f1-5ce97249299b tempest-VolumesNegativeTest-1028193160 tempest-VolumesNegativeTest-1028193160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46771ec6b0af4283b16eadaa4c81a97e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '867df4a337884f3ba55b96cae97c9dd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:03:31.655548 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-fbf39e92-d0f9-41ba-a6f1-5ce97249299b tempest-VolumesNegativeTest-1028193160 tempest-VolumesNegativeTest-1028193160-project] 10.222.0.47 "GET /compute/v2.1/servers/3d02af20-1c93-4a68-a24d-8685406d9eb1" status: 200 len: 1218 microversion: 2.1 time: 0.184050 Feb 19 05:03:31.656479 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 249/508] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:03:31 2021] GET /compute/v2.1/servers/3d02af20-1c93-4a68-a24d-8685406d9eb1 => generated 1218 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 05:03:31.924852 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-8863dd04-35a6-4f7e-9f22-914326741c93 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:03:31.925532 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-8863dd04-35a6-4f7e-9f22-914326741c93 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] [instance: 3aafde29-2f77-4921-9580-05730dd73604] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:03:31.953014 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-8863dd04-35a6-4f7e-9f22-914326741c93 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:31.953969 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-8863dd04-35a6-4f7e-9f22-914326741c93 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:31.955056 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-8863dd04-35a6-4f7e-9f22-914326741c93 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:31.955787 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-8863dd04-35a6-4f7e-9f22-914326741c93 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:32.376977 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-38560013-f720-42c1-a854-70039a48d263 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:03:32.378139 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-38560013-f720-42c1-a854-70039a48d263 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] [instance: 798b77ff-c3ca-4c65-a120-db12ad953621] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:03:32.389848 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-38560013-f720-42c1-a854-70039a48d263 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:32.390656 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-38560013-f720-42c1-a854-70039a48d263 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:32.392564 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-38560013-f720-42c1-a854-70039a48d263 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:32.393324 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-38560013-f720-42c1-a854-70039a48d263 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:33.256433 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-38560013-f720-42c1-a854-70039a48d263 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:03:33.269233 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-38560013-f720-42c1-a854-70039a48d263 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:03:33.277442 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-38560013-f720-42c1-a854-70039a48d263 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:03:33.278739 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-38560013-f720-42c1-a854-70039a48d263 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] 10.222.0.47 "GET /compute/v2.1/servers/798b77ff-c3ca-4c65-a120-db12ad953621" status: 200 len: 1810 microversion: 2.20 time: 0.910182 Feb 19 05:03:33.279374 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 250/509] 10.222.0.47 () {60 vars in 1267 bytes} [Fri Feb 19 05:03:32 2021] GET /compute/v2.1/servers/798b77ff-c3ca-4c65-a120-db12ad953621 => generated 1810 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 05:03:33.289538 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-1a3ad537-31ea-462e-978c-74d98416e6a5 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:03:33.295175 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-1a3ad537-31ea-462e-978c-74d98416e6a5 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] [instance: 74c5a115-b174-49fe-9b75-574e484a09e2] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:03:33.312025 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-1a3ad537-31ea-462e-978c-74d98416e6a5 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:33.312533 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-1a3ad537-31ea-462e-978c-74d98416e6a5 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:33.313792 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-1a3ad537-31ea-462e-978c-74d98416e6a5 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:33.314028 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-1a3ad537-31ea-462e-978c-74d98416e6a5 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:33.345483 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-8863dd04-35a6-4f7e-9f22-914326741c93 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628d846121a14be78329ccc727c8869d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa473e12960449bbb0713a709e0abe4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:03:33.367926 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-8863dd04-35a6-4f7e-9f22-914326741c93 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] 10.222.0.47 "GET /compute/v2.1/servers/3aafde29-2f77-4921-9580-05730dd73604" status: 200 len: 1515 microversion: 2.1 time: 1.447728 Feb 19 05:03:33.368595 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 260/510] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:03:31 2021] GET /compute/v2.1/servers/3aafde29-2f77-4921-9580-05730dd73604 => generated 1515 bytes in 1449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:03:33.384316 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-a80c4b0d-cb81-4ca6-b986-b5500b88d89b tempest-VolumesNegativeTest-1028193160 tempest-VolumesNegativeTest-1028193160-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:03:33.384911 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-a80c4b0d-cb81-4ca6-b986-b5500b88d89b tempest-VolumesNegativeTest-1028193160 tempest-VolumesNegativeTest-1028193160-project] [instance: 3d02af20-1c93-4a68-a24d-8685406d9eb1] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:03:33.399727 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-a80c4b0d-cb81-4ca6-b986-b5500b88d89b tempest-VolumesNegativeTest-1028193160 tempest-VolumesNegativeTest-1028193160-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:33.404085 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-a80c4b0d-cb81-4ca6-b986-b5500b88d89b tempest-VolumesNegativeTest-1028193160 tempest-VolumesNegativeTest-1028193160-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:33.405208 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-a80c4b0d-cb81-4ca6-b986-b5500b88d89b tempest-VolumesNegativeTest-1028193160 tempest-VolumesNegativeTest-1028193160-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:33.405865 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-a80c4b0d-cb81-4ca6-b986-b5500b88d89b tempest-VolumesNegativeTest-1028193160 tempest-VolumesNegativeTest-1028193160-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:33.625246 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-a80c4b0d-cb81-4ca6-b986-b5500b88d89b tempest-VolumesNegativeTest-1028193160 tempest-VolumesNegativeTest-1028193160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46771ec6b0af4283b16eadaa4c81a97e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '867df4a337884f3ba55b96cae97c9dd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:03:33.670493 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-a80c4b0d-cb81-4ca6-b986-b5500b88d89b tempest-VolumesNegativeTest-1028193160 tempest-VolumesNegativeTest-1028193160-project] 10.222.0.47 "GET /compute/v2.1/servers/3d02af20-1c93-4a68-a24d-8685406d9eb1" status: 200 len: 1272 microversion: 2.1 time: 0.300288 Feb 19 05:03:33.672472 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 261/511] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:03:33 2021] GET /compute/v2.1/servers/3d02af20-1c93-4a68-a24d-8685406d9eb1 => generated 1272 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:03:33.696294 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-ccab993e-728c-42cc-9c43-505fa12befda tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:03:33.697829 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-ccab993e-728c-42cc-9c43-505fa12befda tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] [instance: 0d55dde2-c4d7-4da3-9f14-2e6a30f69bcb] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:03:33.732153 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-ccab993e-728c-42cc-9c43-505fa12befda tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:33.738402 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-ccab993e-728c-42cc-9c43-505fa12befda tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:33.740044 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-ccab993e-728c-42cc-9c43-505fa12befda tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:33.740770 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-ccab993e-728c-42cc-9c43-505fa12befda tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:33.832283 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-ccab993e-728c-42cc-9c43-505fa12befda tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] [instance: 0d55dde2-c4d7-4da3-9f14-2e6a30f69bcb] Going to try to terminate instance {{(pid=98154) delete /opt/stack/nova/nova/compute/api.py:2540}} Feb 19 05:03:34.050065 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-ccab993e-728c-42cc-9c43-505fa12befda tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] 10.222.0.47 "DELETE /compute/v2.1/servers/0d55dde2-c4d7-4da3-9f14-2e6a30f69bcb" status: 204 len: 0 microversion: 2.1 time: 0.374992 Feb 19 05:03:34.050929 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 262/512] 10.222.0.47 () {58 vars in 1229 bytes} [Fri Feb 19 05:03:33 2021] DELETE /compute/v2.1/servers/0d55dde2-c4d7-4da3-9f14-2e6a30f69bcb => generated 0 bytes in 377 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 19 05:03:34.065529 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-da87cea5-7768-4f72-b04c-5090dabd5746 tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:03:34.066306 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-da87cea5-7768-4f72-b04c-5090dabd5746 tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] [instance: 0d55dde2-c4d7-4da3-9f14-2e6a30f69bcb] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:03:34.079398 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-da87cea5-7768-4f72-b04c-5090dabd5746 tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:34.080400 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-da87cea5-7768-4f72-b04c-5090dabd5746 tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:34.081454 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-da87cea5-7768-4f72-b04c-5090dabd5746 tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:34.082106 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-da87cea5-7768-4f72-b04c-5090dabd5746 tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:34.149562 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-1a3ad537-31ea-462e-978c-74d98416e6a5 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24af0562e2aa43ca9d601be5e16fe9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ee9a43087d5497da3af9fbf68c4572d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:03:34.161337 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-1a3ad537-31ea-462e-978c-74d98416e6a5 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] 10.222.0.47 "GET /compute/v2.1/servers/74c5a115-b174-49fe-9b75-574e484a09e2" status: 200 len: 1553 microversion: 2.1 time: 0.876218 Feb 19 05:03:34.167595 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 251/513] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:03:33 2021] GET /compute/v2.1/servers/74c5a115-b174-49fe-9b75-574e484a09e2 => generated 1553 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:03:34.304439 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-4a0dc7f9-f2c2-459b-ad71-ae92271e01d8 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:03:34.306051 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-4a0dc7f9-f2c2-459b-ad71-ae92271e01d8 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] [instance: 798b77ff-c3ca-4c65-a120-db12ad953621] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:03:34.316746 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-4a0dc7f9-f2c2-459b-ad71-ae92271e01d8 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:34.321202 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-4a0dc7f9-f2c2-459b-ad71-ae92271e01d8 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:34.322686 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-4a0dc7f9-f2c2-459b-ad71-ae92271e01d8 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:34.323682 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-4a0dc7f9-f2c2-459b-ad71-ae92271e01d8 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:35.126940 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-da87cea5-7768-4f72-b04c-5090dabd5746 tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '876d82b7755b4c1f91c8ad200c0f567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b461024d8cdf4d5c966d746682381d79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:03:35.136617 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-da87cea5-7768-4f72-b04c-5090dabd5746 tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] 10.222.0.47 "GET /compute/v2.1/servers/0d55dde2-c4d7-4da3-9f14-2e6a30f69bcb" status: 200 len: 1512 microversion: 2.1 time: 1.075629 Feb 19 05:03:35.148400 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 263/514] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:03:34 2021] GET /compute/v2.1/servers/0d55dde2-c4d7-4da3-9f14-2e6a30f69bcb => generated 1512 bytes in 1088 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:03:35.154014 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-b353fa2f-0638-4d21-9ce3-bea00fb839cc tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:03:35.154821 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-b353fa2f-0638-4d21-9ce3-bea00fb839cc tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] [instance: 3aafde29-2f77-4921-9580-05730dd73604] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:03:35.163588 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-b353fa2f-0638-4d21-9ce3-bea00fb839cc tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:35.164272 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-b353fa2f-0638-4d21-9ce3-bea00fb839cc tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:35.165265 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-b353fa2f-0638-4d21-9ce3-bea00fb839cc tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:35.166012 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-b353fa2f-0638-4d21-9ce3-bea00fb839cc tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:35.619636 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-4a0dc7f9-f2c2-459b-ad71-ae92271e01d8 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:03:35.641396 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-4a0dc7f9-f2c2-459b-ad71-ae92271e01d8 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:03:35.645212 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-4a0dc7f9-f2c2-459b-ad71-ae92271e01d8 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:03:35.648965 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-4a0dc7f9-f2c2-459b-ad71-ae92271e01d8 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] 10.222.0.47 "GET /compute/v2.1/servers/798b77ff-c3ca-4c65-a120-db12ad953621" status: 200 len: 1810 microversion: 2.20 time: 1.347560 Feb 19 05:03:35.650450 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 252/515] 10.222.0.47 () {60 vars in 1267 bytes} [Fri Feb 19 05:03:34 2021] GET /compute/v2.1/servers/798b77ff-c3ca-4c65-a120-db12ad953621 => generated 1810 bytes in 1351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 05:03:35.661327 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-9331b6cd-5b6d-4cc8-a494-5f35de595645 tempest-VolumesNegativeTest-1028193160 tempest-VolumesNegativeTest-1028193160-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:03:35.663137 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-9331b6cd-5b6d-4cc8-a494-5f35de595645 tempest-VolumesNegativeTest-1028193160 tempest-VolumesNegativeTest-1028193160-project] [instance: 3d02af20-1c93-4a68-a24d-8685406d9eb1] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:03:35.680219 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-9331b6cd-5b6d-4cc8-a494-5f35de595645 tempest-VolumesNegativeTest-1028193160 tempest-VolumesNegativeTest-1028193160-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:35.681609 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-9331b6cd-5b6d-4cc8-a494-5f35de595645 tempest-VolumesNegativeTest-1028193160 tempest-VolumesNegativeTest-1028193160-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:35.683604 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-9331b6cd-5b6d-4cc8-a494-5f35de595645 tempest-VolumesNegativeTest-1028193160 tempest-VolumesNegativeTest-1028193160-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:35.684838 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-9331b6cd-5b6d-4cc8-a494-5f35de595645 tempest-VolumesNegativeTest-1028193160 tempest-VolumesNegativeTest-1028193160-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:36.033975 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-b353fa2f-0638-4d21-9ce3-bea00fb839cc tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628d846121a14be78329ccc727c8869d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa473e12960449bbb0713a709e0abe4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:03:36.058498 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-b353fa2f-0638-4d21-9ce3-bea00fb839cc tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] 10.222.0.47 "GET /compute/v2.1/servers/3aafde29-2f77-4921-9580-05730dd73604" status: 200 len: 1515 microversion: 2.1 time: 0.893860 Feb 19 05:03:36.059273 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 264/516] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:03:35 2021] GET /compute/v2.1/servers/3aafde29-2f77-4921-9580-05730dd73604 => generated 1515 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:03:36.077492 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [req-8c605928-20e2-4eb0-ac41-4d8b83becd7e req-ccce79bc-d988-4e9e-98c3-6283f8f80754 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3aafde29-2f77-4921-9580-05730dd73604", "name": "network-vif-unplugged", "status": "completed", "tag": "bcb6d6a6-4ff3-4e7d-abec-293ccd22f45b"}]} {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:03:36.081418 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 05:03:36.081418 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: warnings.warn(msg) Feb 19 05:03:36.092020 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [req-8c605928-20e2-4eb0-ac41-4d8b83becd7e req-ccce79bc-d988-4e9e-98c3-6283f8f80754 service nova] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:36.092639 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [req-8c605928-20e2-4eb0-ac41-4d8b83becd7e req-ccce79bc-d988-4e9e-98c3-6283f8f80754 service nova] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:36.118755 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.compute.server_external_events [req-8c605928-20e2-4eb0-ac41-4d8b83becd7e req-ccce79bc-d988-4e9e-98c3-6283f8f80754 service nova] Creating event network-vif-unplugged:bcb6d6a6-4ff3-4e7d-abec-293ccd22f45b for instance 3aafde29-2f77-4921-9580-05730dd73604 on hv-cinder-77642 Feb 19 05:03:36.129640 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [req-8c605928-20e2-4eb0-ac41-4d8b83becd7e req-ccce79bc-d988-4e9e-98c3-6283f8f80754 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.068242 Feb 19 05:03:36.131012 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 265/517] 10.222.0.47 () {64 vars in 1308 bytes} [Fri Feb 19 05:03:36 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 05:03:36.145727 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-7f4cc0b7-fbce-4796-8b8b-24adcb513a6e tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:03:36.147237 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-7f4cc0b7-fbce-4796-8b8b-24adcb513a6e tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] [instance: 74c5a115-b174-49fe-9b75-574e484a09e2] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:03:36.164869 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-7f4cc0b7-fbce-4796-8b8b-24adcb513a6e tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:36.165611 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-7f4cc0b7-fbce-4796-8b8b-24adcb513a6e tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:36.167135 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-7f4cc0b7-fbce-4796-8b8b-24adcb513a6e tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:36.167908 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-7f4cc0b7-fbce-4796-8b8b-24adcb513a6e tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:36.257060 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-9331b6cd-5b6d-4cc8-a494-5f35de595645 tempest-VolumesNegativeTest-1028193160 tempest-VolumesNegativeTest-1028193160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46771ec6b0af4283b16eadaa4c81a97e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '867df4a337884f3ba55b96cae97c9dd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:03:36.268204 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-9331b6cd-5b6d-4cc8-a494-5f35de595645 tempest-VolumesNegativeTest-1028193160 tempest-VolumesNegativeTest-1028193160-project] 10.222.0.47 "GET /compute/v2.1/servers/3d02af20-1c93-4a68-a24d-8685406d9eb1" status: 200 len: 1314 microversion: 2.1 time: 0.615766 Feb 19 05:03:36.268851 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 253/518] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:03:35 2021] GET /compute/v2.1/servers/3d02af20-1c93-4a68-a24d-8685406d9eb1 => generated 1314 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:03:36.300437 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-945b3b59-5f3d-4299-9ba2-059df977f5aa tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:03:36.301314 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-945b3b59-5f3d-4299-9ba2-059df977f5aa tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] [instance: 0d55dde2-c4d7-4da3-9f14-2e6a30f69bcb] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:03:36.334800 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-945b3b59-5f3d-4299-9ba2-059df977f5aa tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:36.337158 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-945b3b59-5f3d-4299-9ba2-059df977f5aa tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:36.338085 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-945b3b59-5f3d-4299-9ba2-059df977f5aa tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:36.338583 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-945b3b59-5f3d-4299-9ba2-059df977f5aa tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:37.074797 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-7f4cc0b7-fbce-4796-8b8b-24adcb513a6e tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24af0562e2aa43ca9d601be5e16fe9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ee9a43087d5497da3af9fbf68c4572d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:03:37.086239 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-7f4cc0b7-fbce-4796-8b8b-24adcb513a6e tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] 10.222.0.47 "GET /compute/v2.1/servers/74c5a115-b174-49fe-9b75-574e484a09e2" status: 200 len: 1553 microversion: 2.1 time: 0.949705 Feb 19 05:03:37.086901 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 266/519] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:03:36 2021] GET /compute/v2.1/servers/74c5a115-b174-49fe-9b75-574e484a09e2 => generated 1553 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:03:37.092089 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [req-62135cc1-a1cf-4b2d-9ddb-7bc91e4def76 req-7e505d3c-6274-4879-a931-8fb05bd1b5f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3aafde29-2f77-4921-9580-05730dd73604", "name": "network-vif-deleted", "tag": "bcb6d6a6-4ff3-4e7d-abec-293ccd22f45b"}]} {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:03:37.093778 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 05:03:37.093778 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: warnings.warn(msg) Feb 19 05:03:37.103806 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [req-62135cc1-a1cf-4b2d-9ddb-7bc91e4def76 req-7e505d3c-6274-4879-a931-8fb05bd1b5f5 service nova] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:37.104308 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [req-62135cc1-a1cf-4b2d-9ddb-7bc91e4def76 req-7e505d3c-6274-4879-a931-8fb05bd1b5f5 service nova] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:37.123366 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.compute.server_external_events [req-62135cc1-a1cf-4b2d-9ddb-7bc91e4def76 req-7e505d3c-6274-4879-a931-8fb05bd1b5f5 service nova] Creating event network-vif-deleted:bcb6d6a6-4ff3-4e7d-abec-293ccd22f45b for instance 3aafde29-2f77-4921-9580-05730dd73604 on hv-cinder-77642 Feb 19 05:03:37.130740 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [req-62135cc1-a1cf-4b2d-9ddb-7bc91e4def76 req-7e505d3c-6274-4879-a931-8fb05bd1b5f5 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042321 Feb 19 05:03:37.131721 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 267/520] 10.222.0.47 () {64 vars in 1308 bytes} [Fri Feb 19 05:03:37 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 05:03:37.137347 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-da8321bc-7cd0-4dd0-b95f-7d83faed45f4 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:03:37.138135 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-da8321bc-7cd0-4dd0-b95f-7d83faed45f4 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] [instance: 798b77ff-c3ca-4c65-a120-db12ad953621] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:03:37.147749 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-da8321bc-7cd0-4dd0-b95f-7d83faed45f4 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:37.148263 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-da8321bc-7cd0-4dd0-b95f-7d83faed45f4 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:37.149152 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-da8321bc-7cd0-4dd0-b95f-7d83faed45f4 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:37.149632 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-da8321bc-7cd0-4dd0-b95f-7d83faed45f4 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:38.114004 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-945b3b59-5f3d-4299-9ba2-059df977f5aa tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '876d82b7755b4c1f91c8ad200c0f567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b461024d8cdf4d5c966d746682381d79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:03:38.127080 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-945b3b59-5f3d-4299-9ba2-059df977f5aa tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] 10.222.0.47 "GET /compute/v2.1/servers/0d55dde2-c4d7-4da3-9f14-2e6a30f69bcb" status: 200 len: 1512 microversion: 2.1 time: 1.857002 Feb 19 05:03:38.128470 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 254/521] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:03:36 2021] GET /compute/v2.1/servers/0d55dde2-c4d7-4da3-9f14-2e6a30f69bcb => generated 1512 bytes in 1859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:03:38.134181 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-d9448992-d2b0-420d-904e-5079a5b263ca tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:03:38.135189 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-d9448992-d2b0-420d-904e-5079a5b263ca tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] [instance: 3aafde29-2f77-4921-9580-05730dd73604] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:03:38.145993 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-d9448992-d2b0-420d-904e-5079a5b263ca tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:38.147002 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-d9448992-d2b0-420d-904e-5079a5b263ca tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:38.148308 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-d9448992-d2b0-420d-904e-5079a5b263ca tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:38.149246 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-d9448992-d2b0-420d-904e-5079a5b263ca tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:38.219609 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.wsgi [None req-d9448992-d2b0-420d-904e-5079a5b263ca tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] HTTP exception thrown: Instance 3aafde29-2f77-4921-9580-05730dd73604 could not be found. Feb 19 05:03:38.221468 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-d9448992-d2b0-420d-904e-5079a5b263ca tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Returning 404 to user: Instance 3aafde29-2f77-4921-9580-05730dd73604 could not be found. {{(pid=98153) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 19 05:03:38.224007 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-d9448992-d2b0-420d-904e-5079a5b263ca tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] 10.222.0.47 "GET /compute/v2.1/servers/3aafde29-2f77-4921-9580-05730dd73604" status: 404 len: 111 microversion: 2.1 time: 0.093398 Feb 19 05:03:38.226217 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 255/522] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:03:38 2021] GET /compute/v2.1/servers/3aafde29-2f77-4921-9580-05730dd73604 => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 05:03:38.238330 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-53d1a38a-3bec-4d76-b535-eaca3e395ef5 tempest-VolumesNegativeTest-1028193160 tempest-VolumesNegativeTest-1028193160-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:03:38.240423 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-53d1a38a-3bec-4d76-b535-eaca3e395ef5 tempest-VolumesNegativeTest-1028193160 tempest-VolumesNegativeTest-1028193160-project] [instance: 3d02af20-1c93-4a68-a24d-8685406d9eb1] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:03:38.260180 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-53d1a38a-3bec-4d76-b535-eaca3e395ef5 tempest-VolumesNegativeTest-1028193160 tempest-VolumesNegativeTest-1028193160-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:38.262143 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-53d1a38a-3bec-4d76-b535-eaca3e395ef5 tempest-VolumesNegativeTest-1028193160 tempest-VolumesNegativeTest-1028193160-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:38.264647 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-53d1a38a-3bec-4d76-b535-eaca3e395ef5 tempest-VolumesNegativeTest-1028193160 tempest-VolumesNegativeTest-1028193160-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:38.265976 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-53d1a38a-3bec-4d76-b535-eaca3e395ef5 tempest-VolumesNegativeTest-1028193160 tempest-VolumesNegativeTest-1028193160-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:38.567228 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-da8321bc-7cd0-4dd0-b95f-7d83faed45f4 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:03:38.580562 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-da8321bc-7cd0-4dd0-b95f-7d83faed45f4 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:03:38.588307 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-da8321bc-7cd0-4dd0-b95f-7d83faed45f4 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:03:38.590493 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-da8321bc-7cd0-4dd0-b95f-7d83faed45f4 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] 10.222.0.47 "GET /compute/v2.1/servers/798b77ff-c3ca-4c65-a120-db12ad953621" status: 200 len: 1810 microversion: 2.20 time: 1.457817 Feb 19 05:03:38.591392 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 268/523] 10.222.0.47 () {60 vars in 1267 bytes} [Fri Feb 19 05:03:37 2021] GET /compute/v2.1/servers/798b77ff-c3ca-4c65-a120-db12ad953621 => generated 1810 bytes in 1459 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 05:03:38.597322 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-cee3d1d1-0769-4c4f-af41-4d4e2bf0d68b tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:03:38.598501 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-cee3d1d1-0769-4c4f-af41-4d4e2bf0d68b tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] [instance: 74c5a115-b174-49fe-9b75-574e484a09e2] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:03:38.623992 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-cee3d1d1-0769-4c4f-af41-4d4e2bf0d68b tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:38.624499 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-cee3d1d1-0769-4c4f-af41-4d4e2bf0d68b tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:38.625439 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-cee3d1d1-0769-4c4f-af41-4d4e2bf0d68b tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:38.626086 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-cee3d1d1-0769-4c4f-af41-4d4e2bf0d68b tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:39.177242 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-53d1a38a-3bec-4d76-b535-eaca3e395ef5 tempest-VolumesNegativeTest-1028193160 tempest-VolumesNegativeTest-1028193160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46771ec6b0af4283b16eadaa4c81a97e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '867df4a337884f3ba55b96cae97c9dd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:03:39.191987 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-53d1a38a-3bec-4d76-b535-eaca3e395ef5 tempest-VolumesNegativeTest-1028193160 tempest-VolumesNegativeTest-1028193160-project] 10.222.0.47 "GET /compute/v2.1/servers/3d02af20-1c93-4a68-a24d-8685406d9eb1" status: 200 len: 1314 microversion: 2.1 time: 0.963701 Feb 19 05:03:39.192650 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 256/524] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:03:38 2021] GET /compute/v2.1/servers/3d02af20-1c93-4a68-a24d-8685406d9eb1 => generated 1314 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:03:39.206490 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-51456e0c-01f0-41e2-a1b3-f1aa803689c5 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:03:39.208671 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-51456e0c-01f0-41e2-a1b3-f1aa803689c5 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] [instance: 2182cbf3-8c7a-4e32-937d-baea03567dee] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:03:39.231193 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-51456e0c-01f0-41e2-a1b3-f1aa803689c5 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:39.231758 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-51456e0c-01f0-41e2-a1b3-f1aa803689c5 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:39.232641 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-51456e0c-01f0-41e2-a1b3-f1aa803689c5 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:39.233146 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-51456e0c-01f0-41e2-a1b3-f1aa803689c5 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:39.319162 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-51456e0c-01f0-41e2-a1b3-f1aa803689c5 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] [instance: 2182cbf3-8c7a-4e32-937d-baea03567dee] Going to try to terminate instance {{(pid=98153) delete /opt/stack/nova/nova/compute/api.py:2540}} Feb 19 05:03:39.451029 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-51456e0c-01f0-41e2-a1b3-f1aa803689c5 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] 10.222.0.47 "DELETE /compute/v2.1/servers/2182cbf3-8c7a-4e32-937d-baea03567dee" status: 204 len: 0 microversion: 2.1 time: 0.256277 Feb 19 05:03:39.456624 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 257/525] 10.222.0.47 () {58 vars in 1229 bytes} [Fri Feb 19 05:03:39 2021] DELETE /compute/v2.1/servers/2182cbf3-8c7a-4e32-937d-baea03567dee => generated 0 bytes in 259 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 19 05:03:39.463912 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [req-56af9a2d-3e07-4189-a132-28484b45a55b req-efd69462-d7c1-4567-980f-d517f4786e99 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d55dde2-c4d7-4da3-9f14-2e6a30f69bcb", "name": "network-vif-unplugged", "status": "completed", "tag": "7f6db7b2-7376-4015-ac0e-ba0a99929fb4"}]} {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:03:39.465670 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 05:03:39.465670 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: warnings.warn(msg) Feb 19 05:03:39.475503 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [req-56af9a2d-3e07-4189-a132-28484b45a55b req-efd69462-d7c1-4567-980f-d517f4786e99 service nova] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:39.476005 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [req-56af9a2d-3e07-4189-a132-28484b45a55b req-efd69462-d7c1-4567-980f-d517f4786e99 service nova] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:39.494157 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.compute.server_external_events [req-56af9a2d-3e07-4189-a132-28484b45a55b req-efd69462-d7c1-4567-980f-d517f4786e99 service nova] Creating event network-vif-unplugged:7f6db7b2-7376-4015-ac0e-ba0a99929fb4 for instance 0d55dde2-c4d7-4da3-9f14-2e6a30f69bcb on hv-cinder-77642 Feb 19 05:03:39.499567 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [req-56af9a2d-3e07-4189-a132-28484b45a55b req-efd69462-d7c1-4567-980f-d517f4786e99 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.040892 Feb 19 05:03:39.500348 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 258/526] 10.222.0.47 () {64 vars in 1308 bytes} [Fri Feb 19 05:03:39 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 05:03:39.504798 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-cee3d1d1-0769-4c4f-af41-4d4e2bf0d68b tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24af0562e2aa43ca9d601be5e16fe9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ee9a43087d5497da3af9fbf68c4572d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:03:39.506590 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-a0b58740-37ae-409f-91ad-56639a67d95d tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:03:39.507536 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-a0b58740-37ae-409f-91ad-56639a67d95d tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] [instance: 0d55dde2-c4d7-4da3-9f14-2e6a30f69bcb] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:03:39.516610 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-cee3d1d1-0769-4c4f-af41-4d4e2bf0d68b tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] 10.222.0.47 "GET /compute/v2.1/servers/74c5a115-b174-49fe-9b75-574e484a09e2" status: 200 len: 1559 microversion: 2.1 time: 0.923084 Feb 19 05:03:39.517105 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-a0b58740-37ae-409f-91ad-56639a67d95d tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:39.517610 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-a0b58740-37ae-409f-91ad-56639a67d95d tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:39.518280 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 269/527] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:03:38 2021] GET /compute/v2.1/servers/74c5a115-b174-49fe-9b75-574e484a09e2 => generated 1559 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:03:39.518773 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-a0b58740-37ae-409f-91ad-56639a67d95d tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:39.519266 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-a0b58740-37ae-409f-91ad-56639a67d95d tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:39.524510 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [req-941488f7-b993-419c-a916-26c39ad0481f req-5ccbac0f-fc64-46dc-8bef-0dad167f30ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d02af20-1c93-4a68-a24d-8685406d9eb1", "tag": "42c9d1ca-e4ea-4f56-84c7-c0cc6675d404"}]} {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:03:39.526409 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 05:03:39.526409 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: warnings.warn(msg) Feb 19 05:03:39.538456 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [req-941488f7-b993-419c-a916-26c39ad0481f req-5ccbac0f-fc64-46dc-8bef-0dad167f30ec service nova] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:39.539196 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [req-941488f7-b993-419c-a916-26c39ad0481f req-5ccbac0f-fc64-46dc-8bef-0dad167f30ec service nova] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:39.559664 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.compute.server_external_events [req-941488f7-b993-419c-a916-26c39ad0481f req-5ccbac0f-fc64-46dc-8bef-0dad167f30ec service nova] Creating event network-changed:42c9d1ca-e4ea-4f56-84c7-c0cc6675d404 for instance 3d02af20-1c93-4a68-a24d-8685406d9eb1 on hv-cinder-77642 Feb 19 05:03:39.565648 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [req-941488f7-b993-419c-a916-26c39ad0481f req-5ccbac0f-fc64-46dc-8bef-0dad167f30ec service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045147 Feb 19 05:03:39.566998 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 270/528] 10.222.0.47 () {64 vars in 1308 bytes} [Fri Feb 19 05:03:39 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 05:03:39.573567 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-85526451-e632-4a4e-9b9a-6afd2ae2e76c tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:03:39.574745 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-85526451-e632-4a4e-9b9a-6afd2ae2e76c tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] [instance: 2182cbf3-8c7a-4e32-937d-baea03567dee] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:03:39.585027 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-85526451-e632-4a4e-9b9a-6afd2ae2e76c tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:39.585878 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-85526451-e632-4a4e-9b9a-6afd2ae2e76c tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:39.586969 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-85526451-e632-4a4e-9b9a-6afd2ae2e76c tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:39.587713 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-85526451-e632-4a4e-9b9a-6afd2ae2e76c tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:40.391298 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-a0b58740-37ae-409f-91ad-56639a67d95d tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '876d82b7755b4c1f91c8ad200c0f567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b461024d8cdf4d5c966d746682381d79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:03:40.404116 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-a0b58740-37ae-409f-91ad-56639a67d95d tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] 10.222.0.47 "GET /compute/v2.1/servers/0d55dde2-c4d7-4da3-9f14-2e6a30f69bcb" status: 200 len: 1512 microversion: 2.1 time: 0.902379 Feb 19 05:03:40.405340 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 259/529] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:03:39 2021] GET /compute/v2.1/servers/0d55dde2-c4d7-4da3-9f14-2e6a30f69bcb => generated 1512 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:03:40.411230 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-df6d00d1-b26d-49fd-930e-ebb1a68b5dc7 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:03:40.412186 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-df6d00d1-b26d-49fd-930e-ebb1a68b5dc7 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] [instance: 798b77ff-c3ca-4c65-a120-db12ad953621] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:03:40.420849 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-85526451-e632-4a4e-9b9a-6afd2ae2e76c tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628d846121a14be78329ccc727c8869d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa473e12960449bbb0713a709e0abe4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:03:40.421589 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-df6d00d1-b26d-49fd-930e-ebb1a68b5dc7 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:40.422361 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-df6d00d1-b26d-49fd-930e-ebb1a68b5dc7 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:40.423961 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-df6d00d1-b26d-49fd-930e-ebb1a68b5dc7 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:40.424676 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-df6d00d1-b26d-49fd-930e-ebb1a68b5dc7 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:40.433858 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-85526451-e632-4a4e-9b9a-6afd2ae2e76c tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] 10.222.0.47 "GET /compute/v2.1/servers/2182cbf3-8c7a-4e32-937d-baea03567dee" status: 200 len: 1514 microversion: 2.1 time: 0.865173 Feb 19 05:03:40.436195 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 271/530] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:03:39 2021] GET /compute/v2.1/servers/2182cbf3-8c7a-4e32-937d-baea03567dee => generated 1514 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:03:40.454575 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-907a4a21-8bbe-481e-9c52-38d698dcff4a tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:03:40.455510 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-907a4a21-8bbe-481e-9c52-38d698dcff4a tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] [instance: 74c5a115-b174-49fe-9b75-574e484a09e2] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:03:40.464699 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-907a4a21-8bbe-481e-9c52-38d698dcff4a tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:40.465531 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-907a4a21-8bbe-481e-9c52-38d698dcff4a tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:40.466582 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-907a4a21-8bbe-481e-9c52-38d698dcff4a tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:40.467281 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-907a4a21-8bbe-481e-9c52-38d698dcff4a tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:40.694931 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.objects.instance [None req-907a4a21-8bbe-481e-9c52-38d698dcff4a tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lazy-loading 'services' on Instance uuid 74c5a115-b174-49fe-9b75-574e484a09e2 {{(pid=98154) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Feb 19 05:03:40.874130 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-907a4a21-8bbe-481e-9c52-38d698dcff4a tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] 10.222.0.47 "DELETE /compute/v2.1/servers/74c5a115-b174-49fe-9b75-574e484a09e2/os-volume_attachments/dfeaee6c-a0ad-4a23-ad13-73f31fa31f1c" status: 202 len: 0 microversion: 2.1 time: 0.422006 Feb 19 05:03:40.876166 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 272/531] 10.222.0.47 () {58 vars in 1406 bytes} [Fri Feb 19 05:03:40 2021] DELETE /compute/v2.1/servers/74c5a115-b174-49fe-9b75-574e484a09e2/os-volume_attachments/dfeaee6c-a0ad-4a23-ad13-73f31fa31f1c => generated 0 bytes in 439 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 19 05:03:40.889876 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-43c29bef-011b-47ea-9381-2578e2fe90b3 tempest-VolumesNegativeTest-1028193160 tempest-VolumesNegativeTest-1028193160-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:03:40.893080 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-43c29bef-011b-47ea-9381-2578e2fe90b3 tempest-VolumesNegativeTest-1028193160 tempest-VolumesNegativeTest-1028193160-project] [instance: 3d02af20-1c93-4a68-a24d-8685406d9eb1] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:03:40.908943 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-43c29bef-011b-47ea-9381-2578e2fe90b3 tempest-VolumesNegativeTest-1028193160 tempest-VolumesNegativeTest-1028193160-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:40.909858 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-43c29bef-011b-47ea-9381-2578e2fe90b3 tempest-VolumesNegativeTest-1028193160 tempest-VolumesNegativeTest-1028193160-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:40.912860 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-43c29bef-011b-47ea-9381-2578e2fe90b3 tempest-VolumesNegativeTest-1028193160 tempest-VolumesNegativeTest-1028193160-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:40.914281 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-43c29bef-011b-47ea-9381-2578e2fe90b3 tempest-VolumesNegativeTest-1028193160 tempest-VolumesNegativeTest-1028193160-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:41.364228 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-df6d00d1-b26d-49fd-930e-ebb1a68b5dc7 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:03:41.379502 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-df6d00d1-b26d-49fd-930e-ebb1a68b5dc7 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:03:41.381129 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-df6d00d1-b26d-49fd-930e-ebb1a68b5dc7 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:03:41.383275 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-df6d00d1-b26d-49fd-930e-ebb1a68b5dc7 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] 10.222.0.47 "GET /compute/v2.1/servers/798b77ff-c3ca-4c65-a120-db12ad953621" status: 200 len: 1810 microversion: 2.20 time: 0.975708 Feb 19 05:03:41.384320 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 260/532] 10.222.0.47 () {60 vars in 1267 bytes} [Fri Feb 19 05:03:40 2021] GET /compute/v2.1/servers/798b77ff-c3ca-4c65-a120-db12ad953621 => generated 1810 bytes in 978 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 05:03:41.429352 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-419c2c0f-002d-4047-9862-40d701e1a46b tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:03:41.429352 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-419c2c0f-002d-4047-9862-40d701e1a46b tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] [instance: 0d55dde2-c4d7-4da3-9f14-2e6a30f69bcb] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:03:41.440703 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-419c2c0f-002d-4047-9862-40d701e1a46b tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:41.441249 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-419c2c0f-002d-4047-9862-40d701e1a46b tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:41.443003 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-419c2c0f-002d-4047-9862-40d701e1a46b tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:41.443917 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-419c2c0f-002d-4047-9862-40d701e1a46b tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:41.901305 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-43c29bef-011b-47ea-9381-2578e2fe90b3 tempest-VolumesNegativeTest-1028193160 tempest-VolumesNegativeTest-1028193160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46771ec6b0af4283b16eadaa4c81a97e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '867df4a337884f3ba55b96cae97c9dd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:03:41.917350 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-43c29bef-011b-47ea-9381-2578e2fe90b3 tempest-VolumesNegativeTest-1028193160 tempest-VolumesNegativeTest-1028193160-project] 10.222.0.47 "GET /compute/v2.1/servers/3d02af20-1c93-4a68-a24d-8685406d9eb1" status: 200 len: 1314 microversion: 2.1 time: 1.038634 Feb 19 05:03:41.918733 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 273/533] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:03:40 2021] GET /compute/v2.1/servers/3d02af20-1c93-4a68-a24d-8685406d9eb1 => generated 1314 bytes in 1042 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:03:41.924775 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-fa542448-99c4-4aeb-901f-1a10cd2a8ce2 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:03:41.940789 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-fa542448-99c4-4aeb-901f-1a10cd2a8ce2 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] [instance: 2182cbf3-8c7a-4e32-937d-baea03567dee] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:03:41.956541 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-fa542448-99c4-4aeb-901f-1a10cd2a8ce2 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:41.957456 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-fa542448-99c4-4aeb-901f-1a10cd2a8ce2 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:41.958538 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-fa542448-99c4-4aeb-901f-1a10cd2a8ce2 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:41.959225 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-fa542448-99c4-4aeb-901f-1a10cd2a8ce2 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:42.229840 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-419c2c0f-002d-4047-9862-40d701e1a46b tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '876d82b7755b4c1f91c8ad200c0f567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b461024d8cdf4d5c966d746682381d79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:03:42.248613 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-419c2c0f-002d-4047-9862-40d701e1a46b tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] 10.222.0.47 "GET /compute/v2.1/servers/0d55dde2-c4d7-4da3-9f14-2e6a30f69bcb" status: 200 len: 1512 microversion: 2.1 time: 0.829703 Feb 19 05:03:42.259264 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 261/534] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:03:41 2021] GET /compute/v2.1/servers/0d55dde2-c4d7-4da3-9f14-2e6a30f69bcb => generated 1512 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:03:42.264857 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [req-d455e572-f45a-4d64-94a6-2d9df039909e req-a3c476eb-47b0-4e6e-a8f1-9b16e3850c61 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "798b77ff-c3ca-4c65-a120-db12ad953621", "name": "network-vif-plugged", "status": "completed", "tag": "6af5e97b-75ed-4d80-88eb-6ea5c37a0234"}]} {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:03:42.266725 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 05:03:42.266725 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: warnings.warn(msg) Feb 19 05:03:42.283855 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [req-d455e572-f45a-4d64-94a6-2d9df039909e req-a3c476eb-47b0-4e6e-a8f1-9b16e3850c61 service nova] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:42.284371 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [req-d455e572-f45a-4d64-94a6-2d9df039909e req-a3c476eb-47b0-4e6e-a8f1-9b16e3850c61 service nova] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:42.330103 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.compute.server_external_events [req-d455e572-f45a-4d64-94a6-2d9df039909e req-a3c476eb-47b0-4e6e-a8f1-9b16e3850c61 service nova] Creating event network-vif-plugged:6af5e97b-75ed-4d80-88eb-6ea5c37a0234 for instance 798b77ff-c3ca-4c65-a120-db12ad953621 on hv-cinder-77642 Feb 19 05:03:42.346774 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [req-d455e572-f45a-4d64-94a6-2d9df039909e req-a3c476eb-47b0-4e6e-a8f1-9b16e3850c61 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085878 Feb 19 05:03:42.351107 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 262/535] 10.222.0.47 () {64 vars in 1308 bytes} [Fri Feb 19 05:03:42 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 05:03:42.370989 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [req-c8d8aa1c-412a-44ce-84d4-8fa464fb15c1 req-7bf9d28f-e1d0-415b-8f5d-6b23ce2bd69f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d55dde2-c4d7-4da3-9f14-2e6a30f69bcb", "name": "network-vif-deleted", "tag": "7f6db7b2-7376-4015-ac0e-ba0a99929fb4"}]} {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:03:42.372930 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 05:03:42.372930 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: warnings.warn(msg) Feb 19 05:03:42.405352 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [req-c8d8aa1c-412a-44ce-84d4-8fa464fb15c1 req-7bf9d28f-e1d0-415b-8f5d-6b23ce2bd69f service nova] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:42.406267 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [req-c8d8aa1c-412a-44ce-84d4-8fa464fb15c1 req-7bf9d28f-e1d0-415b-8f5d-6b23ce2bd69f service nova] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:42.451703 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.compute.server_external_events [req-c8d8aa1c-412a-44ce-84d4-8fa464fb15c1 req-7bf9d28f-e1d0-415b-8f5d-6b23ce2bd69f service nova] Creating event network-vif-deleted:7f6db7b2-7376-4015-ac0e-ba0a99929fb4 for instance 0d55dde2-c4d7-4da3-9f14-2e6a30f69bcb on hv-cinder-77642 Feb 19 05:03:42.462177 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [req-c8d8aa1c-412a-44ce-84d4-8fa464fb15c1 req-7bf9d28f-e1d0-415b-8f5d-6b23ce2bd69f service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109058 Feb 19 05:03:42.463436 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 263/536] 10.222.0.47 () {64 vars in 1308 bytes} [Fri Feb 19 05:03:42 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 05:03:42.475709 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-2cc47664-c757-4d3c-ae8a-3e76ceb9c3fe tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:03:42.476865 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-2cc47664-c757-4d3c-ae8a-3e76ceb9c3fe tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] [instance: 798b77ff-c3ca-4c65-a120-db12ad953621] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:03:42.497567 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-2cc47664-c757-4d3c-ae8a-3e76ceb9c3fe tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:42.498580 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-2cc47664-c757-4d3c-ae8a-3e76ceb9c3fe tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:42.501672 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-2cc47664-c757-4d3c-ae8a-3e76ceb9c3fe tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:42.502880 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-2cc47664-c757-4d3c-ae8a-3e76ceb9c3fe tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:42.748639 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-fa542448-99c4-4aeb-901f-1a10cd2a8ce2 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628d846121a14be78329ccc727c8869d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa473e12960449bbb0713a709e0abe4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:03:42.759811 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-fa542448-99c4-4aeb-901f-1a10cd2a8ce2 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] 10.222.0.47 "GET /compute/v2.1/servers/2182cbf3-8c7a-4e32-937d-baea03567dee" status: 200 len: 1514 microversion: 2.1 time: 0.839479 Feb 19 05:03:42.761557 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 274/537] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:03:41 2021] GET /compute/v2.1/servers/2182cbf3-8c7a-4e32-937d-baea03567dee => generated 1514 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:03:42.944473 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-eb7d3331-9503-4416-920b-3b5bcd2735d0 tempest-VolumesNegativeTest-1028193160 tempest-VolumesNegativeTest-1028193160-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:03:42.946110 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-eb7d3331-9503-4416-920b-3b5bcd2735d0 tempest-VolumesNegativeTest-1028193160 tempest-VolumesNegativeTest-1028193160-project] [instance: 3d02af20-1c93-4a68-a24d-8685406d9eb1] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:03:42.975546 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-eb7d3331-9503-4416-920b-3b5bcd2735d0 tempest-VolumesNegativeTest-1028193160 tempest-VolumesNegativeTest-1028193160-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:42.976426 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-eb7d3331-9503-4416-920b-3b5bcd2735d0 tempest-VolumesNegativeTest-1028193160 tempest-VolumesNegativeTest-1028193160-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:42.977440 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-eb7d3331-9503-4416-920b-3b5bcd2735d0 tempest-VolumesNegativeTest-1028193160 tempest-VolumesNegativeTest-1028193160-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:42.978058 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-eb7d3331-9503-4416-920b-3b5bcd2735d0 tempest-VolumesNegativeTest-1028193160 tempest-VolumesNegativeTest-1028193160-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:43.108960 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-2cc47664-c757-4d3c-ae8a-3e76ceb9c3fe tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:03:43.138859 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-2cc47664-c757-4d3c-ae8a-3e76ceb9c3fe tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:03:43.141443 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-2cc47664-c757-4d3c-ae8a-3e76ceb9c3fe tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:03:43.144495 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-2cc47664-c757-4d3c-ae8a-3e76ceb9c3fe tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] 10.222.0.47 "GET /compute/v2.1/servers/798b77ff-c3ca-4c65-a120-db12ad953621" status: 200 len: 1810 microversion: 2.20 time: 0.679141 Feb 19 05:03:43.145488 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 264/538] 10.222.0.47 () {60 vars in 1267 bytes} [Fri Feb 19 05:03:42 2021] GET /compute/v2.1/servers/798b77ff-c3ca-4c65-a120-db12ad953621 => generated 1810 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 05:03:43.150288 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [req-5e1b4cc4-0048-4667-9689-7d9240d13687 req-d3b39242-2011-4249-b2bb-7e45a1ff5418 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2182cbf3-8c7a-4e32-937d-baea03567dee", "name": "network-vif-deleted", "tag": "76750292-0f7c-4d68-a19b-7aaba2d4f5a7"}]} {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:03:43.152445 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 05:03:43.152445 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: warnings.warn(msg) Feb 19 05:03:43.165341 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [req-5e1b4cc4-0048-4667-9689-7d9240d13687 req-d3b39242-2011-4249-b2bb-7e45a1ff5418 service nova] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:43.165845 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [req-5e1b4cc4-0048-4667-9689-7d9240d13687 req-d3b39242-2011-4249-b2bb-7e45a1ff5418 service nova] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:43.201990 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.compute.server_external_events [req-5e1b4cc4-0048-4667-9689-7d9240d13687 req-d3b39242-2011-4249-b2bb-7e45a1ff5418 service nova] Creating event network-vif-deleted:76750292-0f7c-4d68-a19b-7aaba2d4f5a7 for instance 2182cbf3-8c7a-4e32-937d-baea03567dee on hv-cinder-77642 Feb 19 05:03:43.211376 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [req-5e1b4cc4-0048-4667-9689-7d9240d13687 req-d3b39242-2011-4249-b2bb-7e45a1ff5418 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064729 Feb 19 05:03:43.215080 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 265/539] 10.222.0.47 () {64 vars in 1308 bytes} [Fri Feb 19 05:03:43 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 05:03:43.268731 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-9a4f1cad-67b2-4a6a-90f0-bb3c3bfeef60 tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:03:43.269667 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-9a4f1cad-67b2-4a6a-90f0-bb3c3bfeef60 tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] [instance: 0d55dde2-c4d7-4da3-9f14-2e6a30f69bcb] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:03:43.301407 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-9a4f1cad-67b2-4a6a-90f0-bb3c3bfeef60 tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:43.301931 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-9a4f1cad-67b2-4a6a-90f0-bb3c3bfeef60 tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:43.302823 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-9a4f1cad-67b2-4a6a-90f0-bb3c3bfeef60 tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:43.303382 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-9a4f1cad-67b2-4a6a-90f0-bb3c3bfeef60 tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:43.399759 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-9a4f1cad-67b2-4a6a-90f0-bb3c3bfeef60 tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:43.400270 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-9a4f1cad-67b2-4a6a-90f0-bb3c3bfeef60 tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:43.401066 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.objects.instance [None req-9a4f1cad-67b2-4a6a-90f0-bb3c3bfeef60 tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Lazy-loading 'fault' on Instance uuid 0d55dde2-c4d7-4da3-9f14-2e6a30f69bcb {{(pid=98153) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Feb 19 05:03:43.754702 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-9a4f1cad-67b2-4a6a-90f0-bb3c3bfeef60 tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '876d82b7755b4c1f91c8ad200c0f567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b461024d8cdf4d5c966d746682381d79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:03:43.765207 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-9a4f1cad-67b2-4a6a-90f0-bb3c3bfeef60 tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] 10.222.0.47 "GET /compute/v2.1/servers/0d55dde2-c4d7-4da3-9f14-2e6a30f69bcb" status: 200 len: 1308 microversion: 2.1 time: 0.501893 Feb 19 05:03:43.766587 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 266/540] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:03:43 2021] GET /compute/v2.1/servers/0d55dde2-c4d7-4da3-9f14-2e6a30f69bcb => generated 1308 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:03:43.781574 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-b53071d5-8f7e-4e1c-91fb-476ef818fd33 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:03:43.782426 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-b53071d5-8f7e-4e1c-91fb-476ef818fd33 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] [instance: 2182cbf3-8c7a-4e32-937d-baea03567dee] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:03:43.792109 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-b53071d5-8f7e-4e1c-91fb-476ef818fd33 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:43.792823 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-b53071d5-8f7e-4e1c-91fb-476ef818fd33 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:43.793797 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-b53071d5-8f7e-4e1c-91fb-476ef818fd33 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:43.794362 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-b53071d5-8f7e-4e1c-91fb-476ef818fd33 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:43.890261 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-eb7d3331-9503-4416-920b-3b5bcd2735d0 tempest-VolumesNegativeTest-1028193160 tempest-VolumesNegativeTest-1028193160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46771ec6b0af4283b16eadaa4c81a97e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '867df4a337884f3ba55b96cae97c9dd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:03:43.891271 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-b53071d5-8f7e-4e1c-91fb-476ef818fd33 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:43.891875 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-b53071d5-8f7e-4e1c-91fb-476ef818fd33 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:43.892458 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.objects.instance [None req-b53071d5-8f7e-4e1c-91fb-476ef818fd33 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lazy-loading 'fault' on Instance uuid 2182cbf3-8c7a-4e32-937d-baea03567dee {{(pid=98153) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Feb 19 05:03:43.904794 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-eb7d3331-9503-4416-920b-3b5bcd2735d0 tempest-VolumesNegativeTest-1028193160 tempest-VolumesNegativeTest-1028193160-project] 10.222.0.47 "GET /compute/v2.1/servers/3d02af20-1c93-4a68-a24d-8685406d9eb1" status: 200 len: 1314 microversion: 2.1 time: 0.972090 Feb 19 05:03:43.905401 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 275/541] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:03:42 2021] GET /compute/v2.1/servers/3d02af20-1c93-4a68-a24d-8685406d9eb1 => generated 1314 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:03:44.111182 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-b53071d5-8f7e-4e1c-91fb-476ef818fd33 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628d846121a14be78329ccc727c8869d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa473e12960449bbb0713a709e0abe4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:03:44.124383 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-b53071d5-8f7e-4e1c-91fb-476ef818fd33 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] 10.222.0.47 "GET /compute/v2.1/servers/2182cbf3-8c7a-4e32-937d-baea03567dee" status: 200 len: 1307 microversion: 2.1 time: 0.346630 Feb 19 05:03:44.125519 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 267/542] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:03:43 2021] GET /compute/v2.1/servers/2182cbf3-8c7a-4e32-937d-baea03567dee => generated 1307 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:03:44.165184 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-4e40c798-c4fa-47ee-89a4-4dbc7a4ee921 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:03:44.166142 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-4e40c798-c4fa-47ee-89a4-4dbc7a4ee921 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] [instance: 798b77ff-c3ca-4c65-a120-db12ad953621] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:03:44.184146 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-4e40c798-c4fa-47ee-89a4-4dbc7a4ee921 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:44.184878 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-4e40c798-c4fa-47ee-89a4-4dbc7a4ee921 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:44.185881 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-4e40c798-c4fa-47ee-89a4-4dbc7a4ee921 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:44.186526 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-4e40c798-c4fa-47ee-89a4-4dbc7a4ee921 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:44.538008 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-4e40c798-c4fa-47ee-89a4-4dbc7a4ee921 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:03:44.553542 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-4e40c798-c4fa-47ee-89a4-4dbc7a4ee921 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:03:44.555873 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-4e40c798-c4fa-47ee-89a4-4dbc7a4ee921 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:03:44.557147 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-4e40c798-c4fa-47ee-89a4-4dbc7a4ee921 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] 10.222.0.47 "GET /compute/v2.1/servers/798b77ff-c3ca-4c65-a120-db12ad953621" status: 200 len: 1810 microversion: 2.20 time: 0.396061 Feb 19 05:03:44.557911 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 276/543] 10.222.0.47 () {60 vars in 1267 bytes} [Fri Feb 19 05:03:44 2021] GET /compute/v2.1/servers/798b77ff-c3ca-4c65-a120-db12ad953621 => generated 1810 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 05:03:44.786964 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-0510c87b-10bc-4b4a-932c-ffa18cc59101 tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:03:44.788233 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-0510c87b-10bc-4b4a-932c-ffa18cc59101 tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] [instance: 0d55dde2-c4d7-4da3-9f14-2e6a30f69bcb] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:03:44.809134 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-0510c87b-10bc-4b4a-932c-ffa18cc59101 tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:44.810188 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-0510c87b-10bc-4b4a-932c-ffa18cc59101 tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:44.814645 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-0510c87b-10bc-4b4a-932c-ffa18cc59101 tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:44.816689 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-0510c87b-10bc-4b4a-932c-ffa18cc59101 tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:44.943593 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-a0d8340e-f4a8-4ea2-b38f-d00bea7e3208 tempest-VolumesNegativeTest-1028193160 tempest-VolumesNegativeTest-1028193160-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:03:44.950802 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.wsgi [None req-0510c87b-10bc-4b4a-932c-ffa18cc59101 tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] HTTP exception thrown: Instance 0d55dde2-c4d7-4da3-9f14-2e6a30f69bcb could not be found. Feb 19 05:03:44.951623 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-0510c87b-10bc-4b4a-932c-ffa18cc59101 tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Returning 404 to user: Instance 0d55dde2-c4d7-4da3-9f14-2e6a30f69bcb could not be found. {{(pid=98153) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 19 05:03:44.952841 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-0510c87b-10bc-4b4a-932c-ffa18cc59101 tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] 10.222.0.47 "GET /compute/v2.1/servers/0d55dde2-c4d7-4da3-9f14-2e6a30f69bcb" status: 404 len: 111 microversion: 2.1 time: 0.171845 Feb 19 05:03:44.954489 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 268/544] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:03:44 2021] GET /compute/v2.1/servers/0d55dde2-c4d7-4da3-9f14-2e6a30f69bcb => generated 111 bytes in 174 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 05:03:44.956477 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-a0d8340e-f4a8-4ea2-b38f-d00bea7e3208 tempest-VolumesNegativeTest-1028193160 tempest-VolumesNegativeTest-1028193160-project] [instance: 3d02af20-1c93-4a68-a24d-8685406d9eb1] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:03:44.996550 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-a0d8340e-f4a8-4ea2-b38f-d00bea7e3208 tempest-VolumesNegativeTest-1028193160 tempest-VolumesNegativeTest-1028193160-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:44.997074 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-a0d8340e-f4a8-4ea2-b38f-d00bea7e3208 tempest-VolumesNegativeTest-1028193160 tempest-VolumesNegativeTest-1028193160-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:44.997953 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-a0d8340e-f4a8-4ea2-b38f-d00bea7e3208 tempest-VolumesNegativeTest-1028193160 tempest-VolumesNegativeTest-1028193160-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:44.999384 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-a0d8340e-f4a8-4ea2-b38f-d00bea7e3208 tempest-VolumesNegativeTest-1028193160 tempest-VolumesNegativeTest-1028193160-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:45.095965 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-28c30c62-fb10-4a88-8c7a-16a82f4b95d9 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:03:45.096654 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-28c30c62-fb10-4a88-8c7a-16a82f4b95d9 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] [instance: c74e760d-0b53-4508-ae21-494989132c3a] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:03:45.119609 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-28c30c62-fb10-4a88-8c7a-16a82f4b95d9 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:45.121759 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-28c30c62-fb10-4a88-8c7a-16a82f4b95d9 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:45.122758 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-28c30c62-fb10-4a88-8c7a-16a82f4b95d9 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:45.125925 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-28c30c62-fb10-4a88-8c7a-16a82f4b95d9 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:45.296730 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-28c30c62-fb10-4a88-8c7a-16a82f4b95d9 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] [instance: c74e760d-0b53-4508-ae21-494989132c3a] Going to try to terminate instance {{(pid=98153) delete /opt/stack/nova/nova/compute/api.py:2540}} Feb 19 05:03:45.378203 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-a0d8340e-f4a8-4ea2-b38f-d00bea7e3208 tempest-VolumesNegativeTest-1028193160 tempest-VolumesNegativeTest-1028193160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46771ec6b0af4283b16eadaa4c81a97e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '867df4a337884f3ba55b96cae97c9dd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:03:45.390199 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-a0d8340e-f4a8-4ea2-b38f-d00bea7e3208 tempest-VolumesNegativeTest-1028193160 tempest-VolumesNegativeTest-1028193160-project] 10.222.0.47 "GET /compute/v2.1/servers/3d02af20-1c93-4a68-a24d-8685406d9eb1" status: 200 len: 1314 microversion: 2.1 time: 0.470436 Feb 19 05:03:45.397356 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 277/545] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:03:44 2021] GET /compute/v2.1/servers/3d02af20-1c93-4a68-a24d-8685406d9eb1 => generated 1314 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:03:45.402469 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-f767ae01-693f-4cd9-9341-f697a26bddbc tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:03:45.410522 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-f767ae01-693f-4cd9-9341-f697a26bddbc tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] [instance: 2182cbf3-8c7a-4e32-937d-baea03567dee] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:03:45.446344 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-f767ae01-693f-4cd9-9341-f697a26bddbc tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:45.447087 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-f767ae01-693f-4cd9-9341-f697a26bddbc tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:45.448147 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-f767ae01-693f-4cd9-9341-f697a26bddbc tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:45.448804 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-f767ae01-693f-4cd9-9341-f697a26bddbc tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:45.521119 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-28c30c62-fb10-4a88-8c7a-16a82f4b95d9 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] 10.222.0.47 "DELETE /compute/v2.1/servers/c74e760d-0b53-4508-ae21-494989132c3a" status: 204 len: 0 microversion: 2.1 time: 0.429935 Feb 19 05:03:45.529054 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 269/546] 10.222.0.47 () {58 vars in 1229 bytes} [Fri Feb 19 05:03:45 2021] DELETE /compute/v2.1/servers/c74e760d-0b53-4508-ae21-494989132c3a => generated 0 bytes in 438 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 19 05:03:45.538228 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-0dda9ce0-5307-4457-bf9f-76d949c4916c tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:03:45.539808 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-0dda9ce0-5307-4457-bf9f-76d949c4916c tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] [instance: c74e760d-0b53-4508-ae21-494989132c3a] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:03:45.543930 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.wsgi [None req-f767ae01-693f-4cd9-9341-f697a26bddbc tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] HTTP exception thrown: Instance 2182cbf3-8c7a-4e32-937d-baea03567dee could not be found. Feb 19 05:03:45.544810 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-f767ae01-693f-4cd9-9341-f697a26bddbc tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Returning 404 to user: Instance 2182cbf3-8c7a-4e32-937d-baea03567dee could not be found. {{(pid=98154) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 19 05:03:45.545894 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-f767ae01-693f-4cd9-9341-f697a26bddbc tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] 10.222.0.47 "GET /compute/v2.1/servers/2182cbf3-8c7a-4e32-937d-baea03567dee" status: 404 len: 111 microversion: 2.1 time: 0.147454 Feb 19 05:03:45.547276 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 278/547] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:03:45 2021] GET /compute/v2.1/servers/2182cbf3-8c7a-4e32-937d-baea03567dee => generated 111 bytes in 149 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 05:03:45.559535 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-0dda9ce0-5307-4457-bf9f-76d949c4916c tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:45.560211 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-0dda9ce0-5307-4457-bf9f-76d949c4916c tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:45.561077 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-0dda9ce0-5307-4457-bf9f-76d949c4916c tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:45.561576 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-0dda9ce0-5307-4457-bf9f-76d949c4916c tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:45.577322 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-c40f00a9-e4ca-4d2f-9629-af82a599482b tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:03:45.578739 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-c40f00a9-e4ca-4d2f-9629-af82a599482b tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] [instance: 798b77ff-c3ca-4c65-a120-db12ad953621] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:03:45.595677 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-c40f00a9-e4ca-4d2f-9629-af82a599482b tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:45.598207 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-c40f00a9-e4ca-4d2f-9629-af82a599482b tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:45.599430 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-c40f00a9-e4ca-4d2f-9629-af82a599482b tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:45.603721 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-c40f00a9-e4ca-4d2f-9629-af82a599482b tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:46.106708 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-c40f00a9-e4ca-4d2f-9629-af82a599482b tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:03:46.126744 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-c40f00a9-e4ca-4d2f-9629-af82a599482b tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:03:46.130161 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-c40f00a9-e4ca-4d2f-9629-af82a599482b tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:03:46.135916 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-c40f00a9-e4ca-4d2f-9629-af82a599482b tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] 10.222.0.47 "GET /compute/v2.1/servers/798b77ff-c3ca-4c65-a120-db12ad953621" status: 200 len: 1810 microversion: 2.20 time: 0.562460 Feb 19 05:03:46.144859 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 279/548] 10.222.0.47 () {60 vars in 1267 bytes} [Fri Feb 19 05:03:45 2021] GET /compute/v2.1/servers/798b77ff-c3ca-4c65-a120-db12ad953621 => generated 1810 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 19 05:03:46.168047 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-0dda9ce0-5307-4457-bf9f-76d949c4916c tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24af0562e2aa43ca9d601be5e16fe9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ee9a43087d5497da3af9fbf68c4572d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:03:46.179133 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-0dda9ce0-5307-4457-bf9f-76d949c4916c tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] 10.222.0.47 "GET /compute/v2.1/servers/c74e760d-0b53-4508-ae21-494989132c3a" status: 200 len: 1507 microversion: 2.1 time: 0.645384 Feb 19 05:03:46.180368 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 270/549] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:03:45 2021] GET /compute/v2.1/servers/c74e760d-0b53-4508-ae21-494989132c3a => generated 1507 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:03:46.409564 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-8f45be0d-219e-4708-b8cf-541329b23ac1 tempest-VolumesNegativeTest-1028193160 tempest-VolumesNegativeTest-1028193160-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:03:46.411108 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-8f45be0d-219e-4708-b8cf-541329b23ac1 tempest-VolumesNegativeTest-1028193160 tempest-VolumesNegativeTest-1028193160-project] [instance: 3d02af20-1c93-4a68-a24d-8685406d9eb1] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:03:46.441238 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-8f45be0d-219e-4708-b8cf-541329b23ac1 tempest-VolumesNegativeTest-1028193160 tempest-VolumesNegativeTest-1028193160-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:46.442069 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-8f45be0d-219e-4708-b8cf-541329b23ac1 tempest-VolumesNegativeTest-1028193160 tempest-VolumesNegativeTest-1028193160-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:46.448989 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-8f45be0d-219e-4708-b8cf-541329b23ac1 tempest-VolumesNegativeTest-1028193160 tempest-VolumesNegativeTest-1028193160-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:46.450370 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-8f45be0d-219e-4708-b8cf-541329b23ac1 tempest-VolumesNegativeTest-1028193160 tempest-VolumesNegativeTest-1028193160-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:46.749865 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [req-2439f527-570e-475d-b519-5c4f184f71f3 req-5f7097d3-26bb-445b-9c80-303fe595cd05 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d02af20-1c93-4a68-a24d-8685406d9eb1", "name": "network-vif-plugged", "status": "completed", "tag": "42c9d1ca-e4ea-4f56-84c7-c0cc6675d404"}]} {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:03:46.753333 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 05:03:46.753333 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: warnings.warn(msg) Feb 19 05:03:46.774584 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [req-2439f527-570e-475d-b519-5c4f184f71f3 req-5f7097d3-26bb-445b-9c80-303fe595cd05 service nova] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:46.774584 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [req-2439f527-570e-475d-b519-5c4f184f71f3 req-5f7097d3-26bb-445b-9c80-303fe595cd05 service nova] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:46.794889 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-8f45be0d-219e-4708-b8cf-541329b23ac1 tempest-VolumesNegativeTest-1028193160 tempest-VolumesNegativeTest-1028193160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46771ec6b0af4283b16eadaa4c81a97e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '867df4a337884f3ba55b96cae97c9dd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:03:46.818868 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-8f45be0d-219e-4708-b8cf-541329b23ac1 tempest-VolumesNegativeTest-1028193160 tempest-VolumesNegativeTest-1028193160-project] 10.222.0.47 "GET /compute/v2.1/servers/3d02af20-1c93-4a68-a24d-8685406d9eb1" status: 200 len: 1314 microversion: 2.1 time: 0.413893 Feb 19 05:03:46.821150 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 280/550] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:03:46 2021] GET /compute/v2.1/servers/3d02af20-1c93-4a68-a24d-8685406d9eb1 => generated 1314 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:03:46.826540 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.compute.server_external_events [req-2439f527-570e-475d-b519-5c4f184f71f3 req-5f7097d3-26bb-445b-9c80-303fe595cd05 service nova] Creating event network-vif-plugged:42c9d1ca-e4ea-4f56-84c7-c0cc6675d404 for instance 3d02af20-1c93-4a68-a24d-8685406d9eb1 on hv-cinder-77642 Feb 19 05:03:46.834011 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [req-2439f527-570e-475d-b519-5c4f184f71f3 req-5f7097d3-26bb-445b-9c80-303fe595cd05 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089439 Feb 19 05:03:46.835054 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 271/551] 10.222.0.47 () {64 vars in 1308 bytes} [Fri Feb 19 05:03:46 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 05:03:47.164344 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-37cb1993-d794-4d5f-abd2-9f41a2a520c3 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:03:47.165746 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-37cb1993-d794-4d5f-abd2-9f41a2a520c3 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] [instance: 798b77ff-c3ca-4c65-a120-db12ad953621] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:03:47.176212 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-37cb1993-d794-4d5f-abd2-9f41a2a520c3 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:47.177088 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-37cb1993-d794-4d5f-abd2-9f41a2a520c3 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:47.178175 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-37cb1993-d794-4d5f-abd2-9f41a2a520c3 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:47.178863 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-37cb1993-d794-4d5f-abd2-9f41a2a520c3 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:47.201578 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-6f781ccb-7962-4e9a-a44a-9418324adbba tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:03:47.202713 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-6f781ccb-7962-4e9a-a44a-9418324adbba tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] [instance: c74e760d-0b53-4508-ae21-494989132c3a] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:03:47.224869 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-6f781ccb-7962-4e9a-a44a-9418324adbba tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:47.227064 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-6f781ccb-7962-4e9a-a44a-9418324adbba tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:47.238215 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-6f781ccb-7962-4e9a-a44a-9418324adbba tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:47.239152 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-6f781ccb-7962-4e9a-a44a-9418324adbba tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:47.685416 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-6f781ccb-7962-4e9a-a44a-9418324adbba tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24af0562e2aa43ca9d601be5e16fe9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ee9a43087d5497da3af9fbf68c4572d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:03:47.699507 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-6f781ccb-7962-4e9a-a44a-9418324adbba tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] 10.222.0.47 "GET /compute/v2.1/servers/c74e760d-0b53-4508-ae21-494989132c3a" status: 200 len: 1507 microversion: 2.1 time: 0.504334 Feb 19 05:03:47.711310 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 272/552] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:03:47 2021] GET /compute/v2.1/servers/c74e760d-0b53-4508-ae21-494989132c3a => generated 1507 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:03:47.752415 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-37cb1993-d794-4d5f-abd2-9f41a2a520c3 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:03:47.764299 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-37cb1993-d794-4d5f-abd2-9f41a2a520c3 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:03:47.767172 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-37cb1993-d794-4d5f-abd2-9f41a2a520c3 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:03:47.768829 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-37cb1993-d794-4d5f-abd2-9f41a2a520c3 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] 10.222.0.47 "GET /compute/v2.1/servers/798b77ff-c3ca-4c65-a120-db12ad953621" status: 200 len: 1810 microversion: 2.20 time: 0.608858 Feb 19 05:03:47.785767 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 281/553] 10.222.0.47 () {60 vars in 1267 bytes} [Fri Feb 19 05:03:47 2021] GET /compute/v2.1/servers/798b77ff-c3ca-4c65-a120-db12ad953621 => generated 1810 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 05:03:47.840193 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-e7eebe91-7057-4a0d-93b5-c67c22540e1d tempest-VolumesNegativeTest-1028193160 tempest-VolumesNegativeTest-1028193160-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:03:47.840890 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-e7eebe91-7057-4a0d-93b5-c67c22540e1d tempest-VolumesNegativeTest-1028193160 tempest-VolumesNegativeTest-1028193160-project] [instance: 3d02af20-1c93-4a68-a24d-8685406d9eb1] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:03:47.849777 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-e7eebe91-7057-4a0d-93b5-c67c22540e1d tempest-VolumesNegativeTest-1028193160 tempest-VolumesNegativeTest-1028193160-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:47.850643 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-e7eebe91-7057-4a0d-93b5-c67c22540e1d tempest-VolumesNegativeTest-1028193160 tempest-VolumesNegativeTest-1028193160-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:47.852431 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-e7eebe91-7057-4a0d-93b5-c67c22540e1d tempest-VolumesNegativeTest-1028193160 tempest-VolumesNegativeTest-1028193160-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:47.853143 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-e7eebe91-7057-4a0d-93b5-c67c22540e1d tempest-VolumesNegativeTest-1028193160 tempest-VolumesNegativeTest-1028193160-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:48.140967 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-e7eebe91-7057-4a0d-93b5-c67c22540e1d tempest-VolumesNegativeTest-1028193160 tempest-VolumesNegativeTest-1028193160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46771ec6b0af4283b16eadaa4c81a97e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '867df4a337884f3ba55b96cae97c9dd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:03:48.154711 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-e7eebe91-7057-4a0d-93b5-c67c22540e1d tempest-VolumesNegativeTest-1028193160 tempest-VolumesNegativeTest-1028193160-project] 10.222.0.47 "GET /compute/v2.1/servers/3d02af20-1c93-4a68-a24d-8685406d9eb1" status: 200 len: 1314 microversion: 2.1 time: 0.317777 Feb 19 05:03:48.155100 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 273/554] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:03:47 2021] GET /compute/v2.1/servers/3d02af20-1c93-4a68-a24d-8685406d9eb1 => generated 1314 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 05:03:48.622697 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-66e675ac-0211-4065-8aa8-8fb3ac3bdbf4 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:03:48.624247 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-66e675ac-0211-4065-8aa8-8fb3ac3bdbf4 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] [instance: be65ea57-bc8d-4bce-80c3-33d8b6007ed1] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:03:48.645602 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-66e675ac-0211-4065-8aa8-8fb3ac3bdbf4 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:48.646117 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-66e675ac-0211-4065-8aa8-8fb3ac3bdbf4 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:48.647673 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-66e675ac-0211-4065-8aa8-8fb3ac3bdbf4 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:48.655856 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-66e675ac-0211-4065-8aa8-8fb3ac3bdbf4 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:48.721322 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-fa93d0a7-926e-4aa2-8da7-1bd2713f9a27 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:03:48.722015 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-fa93d0a7-926e-4aa2-8da7-1bd2713f9a27 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] [instance: c74e760d-0b53-4508-ae21-494989132c3a] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:03:48.759900 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-fa93d0a7-926e-4aa2-8da7-1bd2713f9a27 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:48.763156 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-fa93d0a7-926e-4aa2-8da7-1bd2713f9a27 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:48.764396 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-fa93d0a7-926e-4aa2-8da7-1bd2713f9a27 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:48.766663 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-fa93d0a7-926e-4aa2-8da7-1bd2713f9a27 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:48.962712 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.objects.instance [None req-66e675ac-0211-4065-8aa8-8fb3ac3bdbf4 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lazy-loading 'services' on Instance uuid be65ea57-bc8d-4bce-80c3-33d8b6007ed1 {{(pid=98154) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Feb 19 05:03:49.107728 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-fa93d0a7-926e-4aa2-8da7-1bd2713f9a27 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24af0562e2aa43ca9d601be5e16fe9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ee9a43087d5497da3af9fbf68c4572d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:03:49.117997 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-fa93d0a7-926e-4aa2-8da7-1bd2713f9a27 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] 10.222.0.47 "GET /compute/v2.1/servers/c74e760d-0b53-4508-ae21-494989132c3a" status: 200 len: 1507 microversion: 2.1 time: 0.403630 Feb 19 05:03:49.130529 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 274/555] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:03:48 2021] GET /compute/v2.1/servers/c74e760d-0b53-4508-ae21-494989132c3a => generated 1507 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:03:49.137654 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-a4904476-3358-407b-96a9-f59f72fcee73 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:03:49.138327 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-a4904476-3358-407b-96a9-f59f72fcee73 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] [instance: 798b77ff-c3ca-4c65-a120-db12ad953621] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:03:49.157991 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-a4904476-3358-407b-96a9-f59f72fcee73 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:49.158523 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-66e675ac-0211-4065-8aa8-8fb3ac3bdbf4 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] 10.222.0.47 "DELETE /compute/v2.1/servers/be65ea57-bc8d-4bce-80c3-33d8b6007ed1/os-volume_attachments/3ce4d0ed-0636-47ee-bb83-93131ea5ec82" status: 202 len: 0 microversion: 2.1 time: 0.540167 Feb 19 05:03:49.158774 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-a4904476-3358-407b-96a9-f59f72fcee73 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:49.160034 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-a4904476-3358-407b-96a9-f59f72fcee73 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:49.160594 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-a4904476-3358-407b-96a9-f59f72fcee73 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:49.165852 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 282/556] 10.222.0.47 () {58 vars in 1406 bytes} [Fri Feb 19 05:03:48 2021] DELETE /compute/v2.1/servers/be65ea57-bc8d-4bce-80c3-33d8b6007ed1/os-volume_attachments/3ce4d0ed-0636-47ee-bb83-93131ea5ec82 => generated 0 bytes in 549 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 19 05:03:49.180495 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-3021132a-1fca-42c0-a914-68e8e91f3f46 tempest-VolumesNegativeTest-1028193160 tempest-VolumesNegativeTest-1028193160-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:03:49.183011 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-3021132a-1fca-42c0-a914-68e8e91f3f46 tempest-VolumesNegativeTest-1028193160 tempest-VolumesNegativeTest-1028193160-project] [instance: 3d02af20-1c93-4a68-a24d-8685406d9eb1] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:03:49.196340 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-3021132a-1fca-42c0-a914-68e8e91f3f46 tempest-VolumesNegativeTest-1028193160 tempest-VolumesNegativeTest-1028193160-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:49.196928 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-3021132a-1fca-42c0-a914-68e8e91f3f46 tempest-VolumesNegativeTest-1028193160 tempest-VolumesNegativeTest-1028193160-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:49.197736 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-3021132a-1fca-42c0-a914-68e8e91f3f46 tempest-VolumesNegativeTest-1028193160 tempest-VolumesNegativeTest-1028193160-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:49.198238 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-3021132a-1fca-42c0-a914-68e8e91f3f46 tempest-VolumesNegativeTest-1028193160 tempest-VolumesNegativeTest-1028193160-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:49.732494 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-a4904476-3358-407b-96a9-f59f72fcee73 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:03:49.743236 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-a4904476-3358-407b-96a9-f59f72fcee73 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:03:49.745201 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-a4904476-3358-407b-96a9-f59f72fcee73 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:03:49.746708 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-a4904476-3358-407b-96a9-f59f72fcee73 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] 10.222.0.47 "GET /compute/v2.1/servers/798b77ff-c3ca-4c65-a120-db12ad953621" status: 200 len: 1797 microversion: 2.20 time: 0.615094 Feb 19 05:03:49.747642 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 275/557] 10.222.0.47 () {60 vars in 1267 bytes} [Fri Feb 19 05:03:49 2021] GET /compute/v2.1/servers/798b77ff-c3ca-4c65-a120-db12ad953621 => generated 1797 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 05:03:49.756491 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-3021132a-1fca-42c0-a914-68e8e91f3f46 tempest-VolumesNegativeTest-1028193160 tempest-VolumesNegativeTest-1028193160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46771ec6b0af4283b16eadaa4c81a97e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '867df4a337884f3ba55b96cae97c9dd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:03:49.765803 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-a71d032c-5a1b-4e39-b700-516503802210 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:03:49.773203 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-a71d032c-5a1b-4e39-b700-516503802210 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] [instance: 9b43c13a-0c7e-45d7-96b0-83fe593a8b08] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:03:49.777226 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-3021132a-1fca-42c0-a914-68e8e91f3f46 tempest-VolumesNegativeTest-1028193160 tempest-VolumesNegativeTest-1028193160-project] 10.222.0.47 "GET /compute/v2.1/servers/3d02af20-1c93-4a68-a24d-8685406d9eb1" status: 200 len: 1314 microversion: 2.1 time: 0.595253 Feb 19 05:03:49.778770 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 283/558] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:03:49 2021] GET /compute/v2.1/servers/3d02af20-1c93-4a68-a24d-8685406d9eb1 => generated 1314 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:03:49.785267 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-a71d032c-5a1b-4e39-b700-516503802210 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:49.786123 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-a71d032c-5a1b-4e39-b700-516503802210 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:49.787176 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-a71d032c-5a1b-4e39-b700-516503802210 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:49.787904 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-a71d032c-5a1b-4e39-b700-516503802210 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:49.915056 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-a71d032c-5a1b-4e39-b700-516503802210 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] [instance: 9b43c13a-0c7e-45d7-96b0-83fe593a8b08] Going to try to terminate instance {{(pid=98153) delete /opt/stack/nova/nova/compute/api.py:2540}} Feb 19 05:03:50.141568 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-0c2eaf02-911f-4542-9794-3f1110209516 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:03:50.142236 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-0c2eaf02-911f-4542-9794-3f1110209516 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] [instance: c74e760d-0b53-4508-ae21-494989132c3a] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:03:50.158865 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-a71d032c-5a1b-4e39-b700-516503802210 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] 10.222.0.47 "DELETE /compute/v2.1/servers/9b43c13a-0c7e-45d7-96b0-83fe593a8b08" status: 204 len: 0 microversion: 2.1 time: 0.406878 Feb 19 05:03:50.160223 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 276/559] 10.222.0.47 () {58 vars in 1229 bytes} [Fri Feb 19 05:03:49 2021] DELETE /compute/v2.1/servers/9b43c13a-0c7e-45d7-96b0-83fe593a8b08 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 19 05:03:50.163177 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-0c2eaf02-911f-4542-9794-3f1110209516 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:50.163764 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-0c2eaf02-911f-4542-9794-3f1110209516 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:50.164877 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-0c2eaf02-911f-4542-9794-3f1110209516 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:50.165372 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-0c2eaf02-911f-4542-9794-3f1110209516 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:50.175676 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-27f24989-4412-47fe-816c-f228e5a1884b tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:03:50.177911 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-27f24989-4412-47fe-816c-f228e5a1884b tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] [instance: 9b43c13a-0c7e-45d7-96b0-83fe593a8b08] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:03:50.198008 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-27f24989-4412-47fe-816c-f228e5a1884b tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:50.199694 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-27f24989-4412-47fe-816c-f228e5a1884b tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:50.202027 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-27f24989-4412-47fe-816c-f228e5a1884b tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:50.203306 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-27f24989-4412-47fe-816c-f228e5a1884b tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:50.684573 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-0c2eaf02-911f-4542-9794-3f1110209516 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24af0562e2aa43ca9d601be5e16fe9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ee9a43087d5497da3af9fbf68c4572d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:03:50.695263 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-0c2eaf02-911f-4542-9794-3f1110209516 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] 10.222.0.47 "GET /compute/v2.1/servers/c74e760d-0b53-4508-ae21-494989132c3a" status: 200 len: 1507 microversion: 2.1 time: 0.558211 Feb 19 05:03:50.717987 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 284/560] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:03:50 2021] GET /compute/v2.1/servers/c74e760d-0b53-4508-ae21-494989132c3a => generated 1507 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:03:50.722334 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-27f24989-4412-47fe-816c-f228e5a1884b tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628d846121a14be78329ccc727c8869d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa473e12960449bbb0713a709e0abe4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:03:50.733619 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-27f24989-4412-47fe-816c-f228e5a1884b tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] 10.222.0.47 "GET /compute/v2.1/servers/9b43c13a-0c7e-45d7-96b0-83fe593a8b08" status: 200 len: 1513 microversion: 2.1 time: 0.568285 Feb 19 05:03:50.735762 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 277/561] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:03:50 2021] GET /compute/v2.1/servers/9b43c13a-0c7e-45d7-96b0-83fe593a8b08 => generated 1513 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:03:50.798862 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-76bddd96-e969-45cd-b55f-4ee3d0df3cf4 tempest-VolumesNegativeTest-1028193160 tempest-VolumesNegativeTest-1028193160-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:03:50.799569 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-76bddd96-e969-45cd-b55f-4ee3d0df3cf4 tempest-VolumesNegativeTest-1028193160 tempest-VolumesNegativeTest-1028193160-project] [instance: 3d02af20-1c93-4a68-a24d-8685406d9eb1] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:03:50.812064 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-76bddd96-e969-45cd-b55f-4ee3d0df3cf4 tempest-VolumesNegativeTest-1028193160 tempest-VolumesNegativeTest-1028193160-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:50.812781 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-76bddd96-e969-45cd-b55f-4ee3d0df3cf4 tempest-VolumesNegativeTest-1028193160 tempest-VolumesNegativeTest-1028193160-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:50.813644 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-76bddd96-e969-45cd-b55f-4ee3d0df3cf4 tempest-VolumesNegativeTest-1028193160 tempest-VolumesNegativeTest-1028193160-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:50.814130 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-76bddd96-e969-45cd-b55f-4ee3d0df3cf4 tempest-VolumesNegativeTest-1028193160 tempest-VolumesNegativeTest-1028193160-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:51.179754 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-76bddd96-e969-45cd-b55f-4ee3d0df3cf4 tempest-VolumesNegativeTest-1028193160 tempest-VolumesNegativeTest-1028193160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46771ec6b0af4283b16eadaa4c81a97e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '867df4a337884f3ba55b96cae97c9dd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:03:51.190897 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-76bddd96-e969-45cd-b55f-4ee3d0df3cf4 tempest-VolumesNegativeTest-1028193160 tempest-VolumesNegativeTest-1028193160-project] 10.222.0.47 "GET /compute/v2.1/servers/3d02af20-1c93-4a68-a24d-8685406d9eb1" status: 200 len: 1464 microversion: 2.1 time: 0.396773 Feb 19 05:03:51.193445 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 285/562] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:03:50 2021] GET /compute/v2.1/servers/3d02af20-1c93-4a68-a24d-8685406d9eb1 => generated 1464 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 05:03:51.279916 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-28e7de6e-f72e-4c27-8341-c5264fd3233b tempest-VolumesNegativeTest-1028193160 tempest-VolumesNegativeTest-1028193160-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:03:51.280487 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-28e7de6e-f72e-4c27-8341-c5264fd3233b tempest-VolumesNegativeTest-1028193160 tempest-VolumesNegativeTest-1028193160-project] [instance: 3d02af20-1c93-4a68-a24d-8685406d9eb1] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:03:51.305322 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-28e7de6e-f72e-4c27-8341-c5264fd3233b tempest-VolumesNegativeTest-1028193160 tempest-VolumesNegativeTest-1028193160-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:51.305584 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-28e7de6e-f72e-4c27-8341-c5264fd3233b tempest-VolumesNegativeTest-1028193160 tempest-VolumesNegativeTest-1028193160-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:51.306703 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-28e7de6e-f72e-4c27-8341-c5264fd3233b tempest-VolumesNegativeTest-1028193160 tempest-VolumesNegativeTest-1028193160-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:51.307443 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-28e7de6e-f72e-4c27-8341-c5264fd3233b tempest-VolumesNegativeTest-1028193160 tempest-VolumesNegativeTest-1028193160-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:51.466554 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-28e7de6e-f72e-4c27-8341-c5264fd3233b tempest-VolumesNegativeTest-1028193160 tempest-VolumesNegativeTest-1028193160-project] [instance: 3d02af20-1c93-4a68-a24d-8685406d9eb1] Going to try to terminate instance {{(pid=98153) delete /opt/stack/nova/nova/compute/api.py:2540}} Feb 19 05:03:51.712923 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-28e7de6e-f72e-4c27-8341-c5264fd3233b tempest-VolumesNegativeTest-1028193160 tempest-VolumesNegativeTest-1028193160-project] 10.222.0.47 "DELETE /compute/v2.1/servers/3d02af20-1c93-4a68-a24d-8685406d9eb1" status: 204 len: 0 microversion: 2.1 time: 0.437006 Feb 19 05:03:51.713917 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 278/563] 10.222.0.47 () {58 vars in 1229 bytes} [Fri Feb 19 05:03:51 2021] DELETE /compute/v2.1/servers/3d02af20-1c93-4a68-a24d-8685406d9eb1 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 19 05:03:51.726463 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-e4aad90c-7a13-42cb-8e91-762d75a6fc78 tempest-VolumesNegativeTest-1028193160 tempest-VolumesNegativeTest-1028193160-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:03:51.727441 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-e4aad90c-7a13-42cb-8e91-762d75a6fc78 tempest-VolumesNegativeTest-1028193160 tempest-VolumesNegativeTest-1028193160-project] [instance: 3d02af20-1c93-4a68-a24d-8685406d9eb1] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:03:51.729279 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-658232b2-3d16-45cf-b40c-5b1325667356 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:03:51.730109 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-658232b2-3d16-45cf-b40c-5b1325667356 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] [instance: c74e760d-0b53-4508-ae21-494989132c3a] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:03:51.751973 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-658232b2-3d16-45cf-b40c-5b1325667356 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:51.752507 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-658232b2-3d16-45cf-b40c-5b1325667356 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:51.753248 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-658232b2-3d16-45cf-b40c-5b1325667356 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:51.753766 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-658232b2-3d16-45cf-b40c-5b1325667356 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:51.756579 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-e4aad90c-7a13-42cb-8e91-762d75a6fc78 tempest-VolumesNegativeTest-1028193160 tempest-VolumesNegativeTest-1028193160-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:51.761352 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-e4aad90c-7a13-42cb-8e91-762d75a6fc78 tempest-VolumesNegativeTest-1028193160 tempest-VolumesNegativeTest-1028193160-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:51.762228 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-e4aad90c-7a13-42cb-8e91-762d75a6fc78 tempest-VolumesNegativeTest-1028193160 tempest-VolumesNegativeTest-1028193160-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:51.767360 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-e4aad90c-7a13-42cb-8e91-762d75a6fc78 tempest-VolumesNegativeTest-1028193160 tempest-VolumesNegativeTest-1028193160-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:52.129500 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-658232b2-3d16-45cf-b40c-5b1325667356 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24af0562e2aa43ca9d601be5e16fe9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ee9a43087d5497da3af9fbf68c4572d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:03:52.142005 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-658232b2-3d16-45cf-b40c-5b1325667356 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] 10.222.0.47 "GET /compute/v2.1/servers/c74e760d-0b53-4508-ae21-494989132c3a" status: 200 len: 1507 microversion: 2.1 time: 0.419568 Feb 19 05:03:52.145479 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 279/564] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:03:51 2021] GET /compute/v2.1/servers/c74e760d-0b53-4508-ae21-494989132c3a => generated 1507 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 05:03:52.161645 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-9dde8c09-9757-4df8-a19e-d8c5e16170aa tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:03:52.162651 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-9dde8c09-9757-4df8-a19e-d8c5e16170aa tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] [instance: 9b43c13a-0c7e-45d7-96b0-83fe593a8b08] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:03:52.173116 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-9dde8c09-9757-4df8-a19e-d8c5e16170aa tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:52.173984 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-9dde8c09-9757-4df8-a19e-d8c5e16170aa tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:52.175062 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-9dde8c09-9757-4df8-a19e-d8c5e16170aa tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:52.180081 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-9dde8c09-9757-4df8-a19e-d8c5e16170aa tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:52.186122 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-e4aad90c-7a13-42cb-8e91-762d75a6fc78 tempest-VolumesNegativeTest-1028193160 tempest-VolumesNegativeTest-1028193160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46771ec6b0af4283b16eadaa4c81a97e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '867df4a337884f3ba55b96cae97c9dd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:03:52.196293 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-e4aad90c-7a13-42cb-8e91-762d75a6fc78 tempest-VolumesNegativeTest-1028193160 tempest-VolumesNegativeTest-1028193160-project] 10.222.0.47 "GET /compute/v2.1/servers/3d02af20-1c93-4a68-a24d-8685406d9eb1" status: 200 len: 1470 microversion: 2.1 time: 0.477923 Feb 19 05:03:52.196951 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 286/565] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:03:51 2021] GET /compute/v2.1/servers/3d02af20-1c93-4a68-a24d-8685406d9eb1 => generated 1470 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:03:52.219542 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-64ad23eb-5a5d-4355-b407-7d4961487293 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:03:52.228021 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-64ad23eb-5a5d-4355-b407-7d4961487293 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:52.228535 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-64ad23eb-5a5d-4355-b407-7d4961487293 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:52.347177 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-64ad23eb-5a5d-4355-b407-7d4961487293 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] [instance: be65ea57-bc8d-4bce-80c3-33d8b6007ed1] Going to try to stop instance {{(pid=98154) force_stop /opt/stack/nova/nova/compute/api.py:2580}} Feb 19 05:03:52.479601 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-64ad23eb-5a5d-4355-b407-7d4961487293 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] 10.222.0.47 "POST /compute/v2.1/servers/be65ea57-bc8d-4bce-80c3-33d8b6007ed1/action" status: 202 len: 0 microversion: 2.1 time: 0.280965 Feb 19 05:03:52.480091 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 287/566] 10.222.0.47 () {60 vars in 1268 bytes} [Fri Feb 19 05:03:52 2021] POST /compute/v2.1/servers/be65ea57-bc8d-4bce-80c3-33d8b6007ed1/action => generated 0 bytes in 283 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 19 05:03:52.489978 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-cbaf4566-3fce-42cf-ad4d-27811079d7ad tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:03:52.490779 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-cbaf4566-3fce-42cf-ad4d-27811079d7ad tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] [instance: be65ea57-bc8d-4bce-80c3-33d8b6007ed1] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:03:52.500945 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-cbaf4566-3fce-42cf-ad4d-27811079d7ad tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:52.501583 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-cbaf4566-3fce-42cf-ad4d-27811079d7ad tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:52.502472 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-cbaf4566-3fce-42cf-ad4d-27811079d7ad tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:52.502976 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-cbaf4566-3fce-42cf-ad4d-27811079d7ad tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:52.732937 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-9dde8c09-9757-4df8-a19e-d8c5e16170aa tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628d846121a14be78329ccc727c8869d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa473e12960449bbb0713a709e0abe4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:03:52.747928 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-9dde8c09-9757-4df8-a19e-d8c5e16170aa tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] 10.222.0.47 "GET /compute/v2.1/servers/9b43c13a-0c7e-45d7-96b0-83fe593a8b08" status: 200 len: 1513 microversion: 2.1 time: 0.587489 Feb 19 05:03:52.748624 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 280/567] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:03:52 2021] GET /compute/v2.1/servers/9b43c13a-0c7e-45d7-96b0-83fe593a8b08 => generated 1513 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:03:52.852218 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-cbaf4566-3fce-42cf-ad4d-27811079d7ad tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3274478c0a421895f43618dc827ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50941a0cab243e9a320ff22a7648de6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:03:52.865631 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-cbaf4566-3fce-42cf-ad4d-27811079d7ad tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] 10.222.0.47 "GET /compute/v2.1/servers/be65ea57-bc8d-4bce-80c3-33d8b6007ed1" status: 200 len: 1675 microversion: 2.1 time: 0.380454 Feb 19 05:03:52.866815 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 288/568] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:03:52 2021] GET /compute/v2.1/servers/be65ea57-bc8d-4bce-80c3-33d8b6007ed1 => generated 1675 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:03:53.169479 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-4cd9f104-61b4-4a22-888c-9a3c7ea57b45 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:03:53.170650 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-4cd9f104-61b4-4a22-888c-9a3c7ea57b45 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] [instance: c74e760d-0b53-4508-ae21-494989132c3a] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:03:53.190463 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-4cd9f104-61b4-4a22-888c-9a3c7ea57b45 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:53.191470 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-4cd9f104-61b4-4a22-888c-9a3c7ea57b45 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:53.192840 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-4cd9f104-61b4-4a22-888c-9a3c7ea57b45 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:53.193758 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-4cd9f104-61b4-4a22-888c-9a3c7ea57b45 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:53.216333 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-a32ca430-c091-4a56-8d81-be517bd3f532 tempest-VolumesNegativeTest-1028193160 tempest-VolumesNegativeTest-1028193160-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:03:53.217520 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-a32ca430-c091-4a56-8d81-be517bd3f532 tempest-VolumesNegativeTest-1028193160 tempest-VolumesNegativeTest-1028193160-project] [instance: 3d02af20-1c93-4a68-a24d-8685406d9eb1] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:03:53.236225 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-a32ca430-c091-4a56-8d81-be517bd3f532 tempest-VolumesNegativeTest-1028193160 tempest-VolumesNegativeTest-1028193160-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:53.239970 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-a32ca430-c091-4a56-8d81-be517bd3f532 tempest-VolumesNegativeTest-1028193160 tempest-VolumesNegativeTest-1028193160-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:53.241263 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-a32ca430-c091-4a56-8d81-be517bd3f532 tempest-VolumesNegativeTest-1028193160 tempest-VolumesNegativeTest-1028193160-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:53.241952 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-a32ca430-c091-4a56-8d81-be517bd3f532 tempest-VolumesNegativeTest-1028193160 tempest-VolumesNegativeTest-1028193160-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:53.335704 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-4cd9f104-61b4-4a22-888c-9a3c7ea57b45 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24af0562e2aa43ca9d601be5e16fe9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ee9a43087d5497da3af9fbf68c4572d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:03:53.347663 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-4cd9f104-61b4-4a22-888c-9a3c7ea57b45 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] 10.222.0.47 "GET /compute/v2.1/servers/c74e760d-0b53-4508-ae21-494989132c3a" status: 200 len: 1465 microversion: 2.1 time: 0.187575 Feb 19 05:03:53.359874 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 281/569] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:03:53 2021] GET /compute/v2.1/servers/c74e760d-0b53-4508-ae21-494989132c3a => generated 1465 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:03:53.607658 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [req-564d9350-2e42-46fa-a448-c06fd724e1f7 req-c0e3ab83-4c5b-4b6b-ab3c-272d5f0d3107 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c74e760d-0b53-4508-ae21-494989132c3a", "name": "network-vif-deleted", "tag": "e575c436-3f73-4d92-a998-905ed7d2d2f2"}]} {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:03:53.614774 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 05:03:53.614774 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: warnings.warn(msg) Feb 19 05:03:53.625975 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [req-564d9350-2e42-46fa-a448-c06fd724e1f7 req-c0e3ab83-4c5b-4b6b-ab3c-272d5f0d3107 service nova] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:53.626487 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [req-564d9350-2e42-46fa-a448-c06fd724e1f7 req-c0e3ab83-4c5b-4b6b-ab3c-272d5f0d3107 service nova] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:53.630066 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-a32ca430-c091-4a56-8d81-be517bd3f532 tempest-VolumesNegativeTest-1028193160 tempest-VolumesNegativeTest-1028193160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46771ec6b0af4283b16eadaa4c81a97e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '867df4a337884f3ba55b96cae97c9dd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:03:53.648187 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-a32ca430-c091-4a56-8d81-be517bd3f532 tempest-VolumesNegativeTest-1028193160 tempest-VolumesNegativeTest-1028193160-project] 10.222.0.47 "GET /compute/v2.1/servers/3d02af20-1c93-4a68-a24d-8685406d9eb1" status: 200 len: 1470 microversion: 2.1 time: 0.437742 Feb 19 05:03:53.648842 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 289/570] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:03:53 2021] GET /compute/v2.1/servers/3d02af20-1c93-4a68-a24d-8685406d9eb1 => generated 1470 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:03:53.661081 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.compute.server_external_events [req-564d9350-2e42-46fa-a448-c06fd724e1f7 req-c0e3ab83-4c5b-4b6b-ab3c-272d5f0d3107 service nova] Creating event network-vif-deleted:e575c436-3f73-4d92-a998-905ed7d2d2f2 for instance c74e760d-0b53-4508-ae21-494989132c3a on hv-cinder-77642 Feb 19 05:03:53.666732 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [req-564d9350-2e42-46fa-a448-c06fd724e1f7 req-c0e3ab83-4c5b-4b6b-ab3c-272d5f0d3107 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063245 Feb 19 05:03:53.667625 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 282/571] 10.222.0.47 () {64 vars in 1308 bytes} [Fri Feb 19 05:03:53 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 19 05:03:53.769867 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-c8db5082-a710-4309-98bc-893288635d34 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:03:53.770474 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-c8db5082-a710-4309-98bc-893288635d34 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] [instance: 9b43c13a-0c7e-45d7-96b0-83fe593a8b08] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:03:53.778803 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-c8db5082-a710-4309-98bc-893288635d34 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:53.779307 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-c8db5082-a710-4309-98bc-893288635d34 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:53.780180 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-c8db5082-a710-4309-98bc-893288635d34 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:53.780677 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-c8db5082-a710-4309-98bc-893288635d34 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:53.888597 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-0e7829eb-9b12-4f96-a30e-a51380be1ca5 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:03:53.889659 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-0e7829eb-9b12-4f96-a30e-a51380be1ca5 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] [instance: be65ea57-bc8d-4bce-80c3-33d8b6007ed1] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:03:53.913338 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-0e7829eb-9b12-4f96-a30e-a51380be1ca5 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:53.913680 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-0e7829eb-9b12-4f96-a30e-a51380be1ca5 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:53.915157 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-0e7829eb-9b12-4f96-a30e-a51380be1ca5 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:53.916082 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-0e7829eb-9b12-4f96-a30e-a51380be1ca5 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:54.555611 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-0e7829eb-9b12-4f96-a30e-a51380be1ca5 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3274478c0a421895f43618dc827ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50941a0cab243e9a320ff22a7648de6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:03:54.566189 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-0e7829eb-9b12-4f96-a30e-a51380be1ca5 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] 10.222.0.47 "GET /compute/v2.1/servers/be65ea57-bc8d-4bce-80c3-33d8b6007ed1" status: 200 len: 1675 microversion: 2.1 time: 0.683662 Feb 19 05:03:54.566557 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-c8db5082-a710-4309-98bc-893288635d34 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628d846121a14be78329ccc727c8869d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa473e12960449bbb0713a709e0abe4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:03:54.569344 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 283/572] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:03:53 2021] GET /compute/v2.1/servers/be65ea57-bc8d-4bce-80c3-33d8b6007ed1 => generated 1675 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:03:54.572767 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-429d1044-74fb-4d88-bae3-e169c677347a tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:03:54.573575 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-429d1044-74fb-4d88-bae3-e169c677347a tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] [instance: c74e760d-0b53-4508-ae21-494989132c3a] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:03:54.577111 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-c8db5082-a710-4309-98bc-893288635d34 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] 10.222.0.47 "GET /compute/v2.1/servers/9b43c13a-0c7e-45d7-96b0-83fe593a8b08" status: 200 len: 1513 microversion: 2.1 time: 0.814374 Feb 19 05:03:54.578570 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 290/573] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:03:53 2021] GET /compute/v2.1/servers/9b43c13a-0c7e-45d7-96b0-83fe593a8b08 => generated 1513 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:03:54.588135 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-429d1044-74fb-4d88-bae3-e169c677347a tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:54.588805 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-429d1044-74fb-4d88-bae3-e169c677347a tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:54.589439 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-429d1044-74fb-4d88-bae3-e169c677347a tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:54.589944 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-429d1044-74fb-4d88-bae3-e169c677347a tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:54.666878 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-bcb4d1de-a85c-4cfb-a185-8b05e7465cd3 tempest-VolumesNegativeTest-1028193160 tempest-VolumesNegativeTest-1028193160-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:03:54.667712 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-bcb4d1de-a85c-4cfb-a185-8b05e7465cd3 tempest-VolumesNegativeTest-1028193160 tempest-VolumesNegativeTest-1028193160-project] [instance: 3d02af20-1c93-4a68-a24d-8685406d9eb1] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:03:54.681884 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-bcb4d1de-a85c-4cfb-a185-8b05e7465cd3 tempest-VolumesNegativeTest-1028193160 tempest-VolumesNegativeTest-1028193160-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:54.682386 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-bcb4d1de-a85c-4cfb-a185-8b05e7465cd3 tempest-VolumesNegativeTest-1028193160 tempest-VolumesNegativeTest-1028193160-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:54.683237 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-bcb4d1de-a85c-4cfb-a185-8b05e7465cd3 tempest-VolumesNegativeTest-1028193160 tempest-VolumesNegativeTest-1028193160-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:54.683757 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-bcb4d1de-a85c-4cfb-a185-8b05e7465cd3 tempest-VolumesNegativeTest-1028193160 tempest-VolumesNegativeTest-1028193160-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:54.730070 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-429d1044-74fb-4d88-bae3-e169c677347a tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24af0562e2aa43ca9d601be5e16fe9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ee9a43087d5497da3af9fbf68c4572d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:03:54.757654 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-429d1044-74fb-4d88-bae3-e169c677347a tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] 10.222.0.47 "GET /compute/v2.1/servers/c74e760d-0b53-4508-ae21-494989132c3a" status: 200 len: 1465 microversion: 2.1 time: 0.187616 Feb 19 05:03:54.759006 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 284/574] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:03:54 2021] GET /compute/v2.1/servers/c74e760d-0b53-4508-ae21-494989132c3a => generated 1465 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:03:55.008501 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-bcb4d1de-a85c-4cfb-a185-8b05e7465cd3 tempest-VolumesNegativeTest-1028193160 tempest-VolumesNegativeTest-1028193160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46771ec6b0af4283b16eadaa4c81a97e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '867df4a337884f3ba55b96cae97c9dd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:03:55.019813 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-bcb4d1de-a85c-4cfb-a185-8b05e7465cd3 tempest-VolumesNegativeTest-1028193160 tempest-VolumesNegativeTest-1028193160-project] 10.222.0.47 "GET /compute/v2.1/servers/3d02af20-1c93-4a68-a24d-8685406d9eb1" status: 200 len: 1470 microversion: 2.1 time: 0.357244 Feb 19 05:03:55.033127 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 291/575] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:03:54 2021] GET /compute/v2.1/servers/3d02af20-1c93-4a68-a24d-8685406d9eb1 => generated 1470 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 05:03:55.291006 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-0f10d6fc-c7f7-43b4-93cf-ae748e8be64f tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-103058990", "imageRef": "53cdf9de-e495-4ca8-845f-6be2bf32cecb", "flavorRef": "452", "networks": [{"uuid": "cbdeecea-e92c-4ac9-9254-261e63b55f49"}]}} {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:03:55.383823 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.network.neutron [None req-0f10d6fc-c7f7-43b4-93cf-ae748e8be64f tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] validate_networks() for [('cbdeecea-e92c-4ac9-9254-261e63b55f49', None, None, None)] {{(pid=98153) validate_networks /opt/stack/nova/nova/network/neutron.py:2345}} Feb 19 05:03:55.585313 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-7d01c1de-40cb-4f4a-b596-15a524377ccd tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:03:55.585982 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-7d01c1de-40cb-4f4a-b596-15a524377ccd tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] [instance: be65ea57-bc8d-4bce-80c3-33d8b6007ed1] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:03:55.601294 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-7d01c1de-40cb-4f4a-b596-15a524377ccd tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:55.601808 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-7d01c1de-40cb-4f4a-b596-15a524377ccd tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:55.602664 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-7d01c1de-40cb-4f4a-b596-15a524377ccd tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:55.603156 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-7d01c1de-40cb-4f4a-b596-15a524377ccd tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:56.119227 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.virt.hardware [None req-0f10d6fc-c7f7-43b4-93cf-ae748e8be64f tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Flavor limits 0:0:0 {{(pid=98153) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 19 05:03:56.119816 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.virt.hardware [None req-0f10d6fc-c7f7-43b4-93cf-ae748e8be64f tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Image limits 0:0:0 {{(pid=98153) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Feb 19 05:03:56.120186 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.virt.hardware [None req-0f10d6fc-c7f7-43b4-93cf-ae748e8be64f tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Flavor pref 0:0:0 {{(pid=98153) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 19 05:03:56.120661 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.virt.hardware [None req-0f10d6fc-c7f7-43b4-93cf-ae748e8be64f tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Image pref 0:0:0 {{(pid=98153) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Feb 19 05:03:56.121146 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.virt.hardware [None req-0f10d6fc-c7f7-43b4-93cf-ae748e8be64f tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98153) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Feb 19 05:03:56.140856 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-0f10d6fc-c7f7-43b4-93cf-ae748e8be64f tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:56.145171 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-0f10d6fc-c7f7-43b4-93cf-ae748e8be64f tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:56.146155 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-0f10d6fc-c7f7-43b4-93cf-ae748e8be64f tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:56.146664 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-0f10d6fc-c7f7-43b4-93cf-ae748e8be64f tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:56.196842 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.quota [None req-0f10d6fc-c7f7-43b4-93cf-ae748e8be64f tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Getting quotas for project b461024d8cdf4d5c966d746682381d79. Resources: {'instances', 'ram', 'cores'} {{(pid=98153) _get_quotas /opt/stack/nova/nova/quota.py:388}} Feb 19 05:03:56.210964 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.quota [None req-0f10d6fc-c7f7-43b4-93cf-ae748e8be64f tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Getting quotas for user 876d82b7755b4c1f91c8ad200c0f567f and project b461024d8cdf4d5c966d746682381d79. Resources: {'instances', 'ram', 'cores'} {{(pid=98153) _get_quotas /opt/stack/nova/nova/quota.py:380}} Feb 19 05:03:56.231425 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-0f10d6fc-c7f7-43b4-93cf-ae748e8be64f tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Going to run 1 instances... {{(pid=98153) _provision_instances /opt/stack/nova/nova/compute/api.py:1264}} Feb 19 05:03:56.234458 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-0f10d6fc-c7f7-43b4-93cf-ae748e8be64f tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] [instance: be41f685-0cdd-4413-8467-43335bd91c60] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='53cdf9de-e495-4ca8-845f-6be2bf32cecb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98153) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1666}} Feb 19 05:03:56.267395 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-7d01c1de-40cb-4f4a-b596-15a524377ccd tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3274478c0a421895f43618dc827ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50941a0cab243e9a320ff22a7648de6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:03:56.280642 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-7d01c1de-40cb-4f4a-b596-15a524377ccd tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] 10.222.0.47 "GET /compute/v2.1/servers/be65ea57-bc8d-4bce-80c3-33d8b6007ed1" status: 200 len: 1675 microversion: 2.1 time: 0.699274 Feb 19 05:03:56.281729 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 292/576] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:03:55 2021] GET /compute/v2.1/servers/be65ea57-bc8d-4bce-80c3-33d8b6007ed1 => generated 1675 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:03:56.286702 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-75830fb8-ea8e-4a29-8aca-749411a3db73 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:03:56.287588 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-75830fb8-ea8e-4a29-8aca-749411a3db73 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] [instance: 9b43c13a-0c7e-45d7-96b0-83fe593a8b08] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:03:56.295763 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-75830fb8-ea8e-4a29-8aca-749411a3db73 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:56.296652 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-75830fb8-ea8e-4a29-8aca-749411a3db73 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:56.298017 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-75830fb8-ea8e-4a29-8aca-749411a3db73 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:56.298743 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-75830fb8-ea8e-4a29-8aca-749411a3db73 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:56.330835 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-0f10d6fc-c7f7-43b4-93cf-ae748e8be64f tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.045326 Feb 19 05:03:56.340528 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 285/577] 10.222.0.47 () {60 vars in 1137 bytes} [Fri Feb 19 05:03:55 2021] POST /compute/v2.1/servers => generated 380 bytes in 1056 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 19 05:03:56.346526 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-aba11117-0892-4256-bd92-863fe1908a18 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:03:56.347273 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-aba11117-0892-4256-bd92-863fe1908a18 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] [instance: c74e760d-0b53-4508-ae21-494989132c3a] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:03:56.370834 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-aba11117-0892-4256-bd92-863fe1908a18 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:56.371277 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-aba11117-0892-4256-bd92-863fe1908a18 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:56.372234 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-aba11117-0892-4256-bd92-863fe1908a18 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:56.372745 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-aba11117-0892-4256-bd92-863fe1908a18 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:56.506523 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.wsgi [None req-aba11117-0892-4256-bd92-863fe1908a18 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] HTTP exception thrown: Instance c74e760d-0b53-4508-ae21-494989132c3a could not be found. Feb 19 05:03:56.512879 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-aba11117-0892-4256-bd92-863fe1908a18 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Returning 404 to user: Instance c74e760d-0b53-4508-ae21-494989132c3a could not be found. {{(pid=98153) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 19 05:03:56.513864 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-aba11117-0892-4256-bd92-863fe1908a18 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] 10.222.0.47 "GET /compute/v2.1/servers/c74e760d-0b53-4508-ae21-494989132c3a" status: 404 len: 111 microversion: 2.1 time: 0.172137 Feb 19 05:03:56.514522 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 286/578] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:03:56 2021] GET /compute/v2.1/servers/c74e760d-0b53-4508-ae21-494989132c3a => generated 111 bytes in 173 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 05:03:56.527360 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-ba36dcb1-9443-41a7-803f-c167cac568cf tempest-VolumesNegativeTest-1028193160 tempest-VolumesNegativeTest-1028193160-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:03:56.537402 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-ba36dcb1-9443-41a7-803f-c167cac568cf tempest-VolumesNegativeTest-1028193160 tempest-VolumesNegativeTest-1028193160-project] [instance: 3d02af20-1c93-4a68-a24d-8685406d9eb1] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:03:56.555377 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-ba36dcb1-9443-41a7-803f-c167cac568cf tempest-VolumesNegativeTest-1028193160 tempest-VolumesNegativeTest-1028193160-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:56.555906 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-ba36dcb1-9443-41a7-803f-c167cac568cf tempest-VolumesNegativeTest-1028193160 tempest-VolumesNegativeTest-1028193160-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:56.556783 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-ba36dcb1-9443-41a7-803f-c167cac568cf tempest-VolumesNegativeTest-1028193160 tempest-VolumesNegativeTest-1028193160-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:56.557286 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-ba36dcb1-9443-41a7-803f-c167cac568cf tempest-VolumesNegativeTest-1028193160 tempest-VolumesNegativeTest-1028193160-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:56.797902 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-75830fb8-ea8e-4a29-8aca-749411a3db73 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628d846121a14be78329ccc727c8869d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa473e12960449bbb0713a709e0abe4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:03:56.814754 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-75830fb8-ea8e-4a29-8aca-749411a3db73 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] 10.222.0.47 "GET /compute/v2.1/servers/9b43c13a-0c7e-45d7-96b0-83fe593a8b08" status: 200 len: 1513 microversion: 2.1 time: 0.531530 Feb 19 05:03:56.816460 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 293/579] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:03:56 2021] GET /compute/v2.1/servers/9b43c13a-0c7e-45d7-96b0-83fe593a8b08 => generated 1513 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:03:56.840699 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [req-9ebf32cd-8c3f-46b4-af4b-032904a403a8 req-80b6132b-4162-4758-a300-40d17ea245b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b43c13a-0c7e-45d7-96b0-83fe593a8b08", "name": "network-vif-unplugged", "status": "completed", "tag": "bf7bd73f-da1c-4506-980b-db75cc18c728"}]} {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:03:56.842693 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 05:03:56.842693 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: warnings.warn(msg) Feb 19 05:03:56.863754 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [req-9ebf32cd-8c3f-46b4-af4b-032904a403a8 req-80b6132b-4162-4758-a300-40d17ea245b4 service nova] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:56.864416 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [req-9ebf32cd-8c3f-46b4-af4b-032904a403a8 req-80b6132b-4162-4758-a300-40d17ea245b4 service nova] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:56.897911 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.compute.server_external_events [req-9ebf32cd-8c3f-46b4-af4b-032904a403a8 req-80b6132b-4162-4758-a300-40d17ea245b4 service nova] Creating event network-vif-unplugged:bf7bd73f-da1c-4506-980b-db75cc18c728 for instance 9b43c13a-0c7e-45d7-96b0-83fe593a8b08 on hv-cinder-77642 Feb 19 05:03:56.907071 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [req-9ebf32cd-8c3f-46b4-af4b-032904a403a8 req-80b6132b-4162-4758-a300-40d17ea245b4 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.069190 Feb 19 05:03:56.908092 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 294/580] 10.222.0.47 () {64 vars in 1308 bytes} [Fri Feb 19 05:03:56 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 05:03:56.916864 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-615b22f0-1b6b-4056-a9f3-f9a603ab4638 tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:03:56.918430 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-615b22f0-1b6b-4056-a9f3-f9a603ab4638 tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] [instance: be41f685-0cdd-4413-8467-43335bd91c60] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:03:57.114072 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-615b22f0-1b6b-4056-a9f3-f9a603ab4638 tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '876d82b7755b4c1f91c8ad200c0f567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b461024d8cdf4d5c966d746682381d79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:03:57.126959 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-615b22f0-1b6b-4056-a9f3-f9a603ab4638 tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] 10.222.0.47 "GET /compute/v2.1/servers/be41f685-0cdd-4413-8467-43335bd91c60" status: 200 len: 1218 microversion: 2.1 time: 0.216764 Feb 19 05:03:57.128501 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 295/581] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:03:56 2021] GET /compute/v2.1/servers/be41f685-0cdd-4413-8467-43335bd91c60 => generated 1218 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:03:57.134242 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-19cb7343-17b3-4b33-9d2f-7ea410792722 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:03:57.135097 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-19cb7343-17b3-4b33-9d2f-7ea410792722 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] [instance: 74c5a115-b174-49fe-9b75-574e484a09e2] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:03:57.145577 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-19cb7343-17b3-4b33-9d2f-7ea410792722 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:57.146577 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-19cb7343-17b3-4b33-9d2f-7ea410792722 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:57.147689 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-19cb7343-17b3-4b33-9d2f-7ea410792722 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:57.148481 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-19cb7343-17b3-4b33-9d2f-7ea410792722 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:57.150916 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-ba36dcb1-9443-41a7-803f-c167cac568cf tempest-VolumesNegativeTest-1028193160 tempest-VolumesNegativeTest-1028193160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46771ec6b0af4283b16eadaa4c81a97e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '867df4a337884f3ba55b96cae97c9dd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:03:57.166902 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-ba36dcb1-9443-41a7-803f-c167cac568cf tempest-VolumesNegativeTest-1028193160 tempest-VolumesNegativeTest-1028193160-project] 10.222.0.47 "GET /compute/v2.1/servers/3d02af20-1c93-4a68-a24d-8685406d9eb1" status: 200 len: 1470 microversion: 2.1 time: 0.651218 Feb 19 05:03:57.179567 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 287/582] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:03:56 2021] GET /compute/v2.1/servers/3d02af20-1c93-4a68-a24d-8685406d9eb1 => generated 1470 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:03:57.252544 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-19cb7343-17b3-4b33-9d2f-7ea410792722 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] [instance: 74c5a115-b174-49fe-9b75-574e484a09e2] Going to try to terminate instance {{(pid=98154) delete /opt/stack/nova/nova/compute/api.py:2540}} Feb 19 05:03:57.317746 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-68f4fae6-9602-444d-9ec3-d3effb88dcb5 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:03:57.318545 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-68f4fae6-9602-444d-9ec3-d3effb88dcb5 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] [instance: be65ea57-bc8d-4bce-80c3-33d8b6007ed1] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:03:57.326498 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-68f4fae6-9602-444d-9ec3-d3effb88dcb5 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:57.327037 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-68f4fae6-9602-444d-9ec3-d3effb88dcb5 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:57.328509 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-68f4fae6-9602-444d-9ec3-d3effb88dcb5 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:57.329081 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-68f4fae6-9602-444d-9ec3-d3effb88dcb5 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:57.476608 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-19cb7343-17b3-4b33-9d2f-7ea410792722 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] 10.222.0.47 "DELETE /compute/v2.1/servers/74c5a115-b174-49fe-9b75-574e484a09e2" status: 204 len: 0 microversion: 2.1 time: 0.346384 Feb 19 05:03:57.477744 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 296/583] 10.222.0.47 () {58 vars in 1229 bytes} [Fri Feb 19 05:03:57 2021] DELETE /compute/v2.1/servers/74c5a115-b174-49fe-9b75-574e484a09e2 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 19 05:03:57.490134 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-9a841f3d-e03d-47f1-85b6-5a0eb69ad5fa tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:03:57.490911 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-9a841f3d-e03d-47f1-85b6-5a0eb69ad5fa tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] [instance: 74c5a115-b174-49fe-9b75-574e484a09e2] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:03:57.514117 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-9a841f3d-e03d-47f1-85b6-5a0eb69ad5fa tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:57.514728 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-9a841f3d-e03d-47f1-85b6-5a0eb69ad5fa tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:57.516345 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-9a841f3d-e03d-47f1-85b6-5a0eb69ad5fa tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:57.517048 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-9a841f3d-e03d-47f1-85b6-5a0eb69ad5fa tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:58.107085 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-68f4fae6-9602-444d-9ec3-d3effb88dcb5 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3274478c0a421895f43618dc827ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50941a0cab243e9a320ff22a7648de6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:03:58.130347 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-68f4fae6-9602-444d-9ec3-d3effb88dcb5 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] 10.222.0.47 "GET /compute/v2.1/servers/be65ea57-bc8d-4bce-80c3-33d8b6007ed1" status: 200 len: 1675 microversion: 2.1 time: 0.816697 Feb 19 05:03:58.131660 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 288/584] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:03:57 2021] GET /compute/v2.1/servers/be65ea57-bc8d-4bce-80c3-33d8b6007ed1 => generated 1675 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:03:58.151957 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-2e7a041b-3c4d-4eae-8adb-892eb2c26d01 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:03:58.164347 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-2e7a041b-3c4d-4eae-8adb-892eb2c26d01 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] [instance: 9b43c13a-0c7e-45d7-96b0-83fe593a8b08] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:03:58.174038 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-2e7a041b-3c4d-4eae-8adb-892eb2c26d01 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:58.180257 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-2e7a041b-3c4d-4eae-8adb-892eb2c26d01 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:58.182906 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-2e7a041b-3c4d-4eae-8adb-892eb2c26d01 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:58.187871 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-2e7a041b-3c4d-4eae-8adb-892eb2c26d01 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:58.217806 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-9a841f3d-e03d-47f1-85b6-5a0eb69ad5fa tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24af0562e2aa43ca9d601be5e16fe9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ee9a43087d5497da3af9fbf68c4572d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:03:58.230485 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-9a841f3d-e03d-47f1-85b6-5a0eb69ad5fa tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] 10.222.0.47 "GET /compute/v2.1/servers/74c5a115-b174-49fe-9b75-574e484a09e2" status: 200 len: 1519 microversion: 2.1 time: 0.748066 Feb 19 05:03:58.232008 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 297/585] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:03:57 2021] GET /compute/v2.1/servers/74c5a115-b174-49fe-9b75-574e484a09e2 => generated 1519 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:03:58.243488 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-952d8952-aaf4-4aaf-a1b2-30fc6a9933f1 tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:03:58.249758 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-952d8952-aaf4-4aaf-a1b2-30fc6a9933f1 tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] [instance: be41f685-0cdd-4413-8467-43335bd91c60] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:03:58.281931 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-952d8952-aaf4-4aaf-a1b2-30fc6a9933f1 tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:58.284029 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-952d8952-aaf4-4aaf-a1b2-30fc6a9933f1 tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:58.285094 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-952d8952-aaf4-4aaf-a1b2-30fc6a9933f1 tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:58.294373 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-952d8952-aaf4-4aaf-a1b2-30fc6a9933f1 tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:58.545461 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-952d8952-aaf4-4aaf-a1b2-30fc6a9933f1 tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '876d82b7755b4c1f91c8ad200c0f567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b461024d8cdf4d5c966d746682381d79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:03:58.567904 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-952d8952-aaf4-4aaf-a1b2-30fc6a9933f1 tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] 10.222.0.47 "GET /compute/v2.1/servers/be41f685-0cdd-4413-8467-43335bd91c60" status: 200 len: 1278 microversion: 2.1 time: 0.332929 Feb 19 05:03:58.569413 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 298/586] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:03:58 2021] GET /compute/v2.1/servers/be41f685-0cdd-4413-8467-43335bd91c60 => generated 1278 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:03:58.580434 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-35805c7a-2ced-4efd-b538-a30276595d31 tempest-VolumesNegativeTest-1028193160 tempest-VolumesNegativeTest-1028193160-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:03:58.581909 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-35805c7a-2ced-4efd-b538-a30276595d31 tempest-VolumesNegativeTest-1028193160 tempest-VolumesNegativeTest-1028193160-project] [instance: 3d02af20-1c93-4a68-a24d-8685406d9eb1] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:03:58.600953 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-35805c7a-2ced-4efd-b538-a30276595d31 tempest-VolumesNegativeTest-1028193160 tempest-VolumesNegativeTest-1028193160-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:58.603013 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-35805c7a-2ced-4efd-b538-a30276595d31 tempest-VolumesNegativeTest-1028193160 tempest-VolumesNegativeTest-1028193160-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:58.603871 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-35805c7a-2ced-4efd-b538-a30276595d31 tempest-VolumesNegativeTest-1028193160 tempest-VolumesNegativeTest-1028193160-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:58.605164 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-35805c7a-2ced-4efd-b538-a30276595d31 tempest-VolumesNegativeTest-1028193160 tempest-VolumesNegativeTest-1028193160-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:58.896350 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-35805c7a-2ced-4efd-b538-a30276595d31 tempest-VolumesNegativeTest-1028193160 tempest-VolumesNegativeTest-1028193160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46771ec6b0af4283b16eadaa4c81a97e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '867df4a337884f3ba55b96cae97c9dd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:03:58.914805 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-35805c7a-2ced-4efd-b538-a30276595d31 tempest-VolumesNegativeTest-1028193160 tempest-VolumesNegativeTest-1028193160-project] 10.222.0.47 "GET /compute/v2.1/servers/3d02af20-1c93-4a68-a24d-8685406d9eb1" status: 200 len: 1428 microversion: 2.1 time: 0.343775 Feb 19 05:03:58.916834 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 299/587] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:03:58 2021] GET /compute/v2.1/servers/3d02af20-1c93-4a68-a24d-8685406d9eb1 => generated 1428 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:03:58.923771 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-2e7a041b-3c4d-4eae-8adb-892eb2c26d01 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628d846121a14be78329ccc727c8869d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa473e12960449bbb0713a709e0abe4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:03:58.972008 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-2e7a041b-3c4d-4eae-8adb-892eb2c26d01 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] 10.222.0.47 "GET /compute/v2.1/servers/9b43c13a-0c7e-45d7-96b0-83fe593a8b08" status: 200 len: 1513 microversion: 2.1 time: 0.825895 Feb 19 05:03:58.972792 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 289/588] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:03:58 2021] GET /compute/v2.1/servers/9b43c13a-0c7e-45d7-96b0-83fe593a8b08 => generated 1513 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:03:59.026941 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [req-18b833cb-733c-4aec-b2f4-bd6aa6e61886 req-4cd0c6f2-3f1a-4cb8-897d-ebb45bede018 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d02af20-1c93-4a68-a24d-8685406d9eb1", "name": "network-vif-deleted", "tag": "42c9d1ca-e4ea-4f56-84c7-c0cc6675d404"}]} {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:03:59.028912 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 05:03:59.028912 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: warnings.warn(msg) Feb 19 05:03:59.049666 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [req-18b833cb-733c-4aec-b2f4-bd6aa6e61886 req-4cd0c6f2-3f1a-4cb8-897d-ebb45bede018 service nova] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:59.050160 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [req-18b833cb-733c-4aec-b2f4-bd6aa6e61886 req-4cd0c6f2-3f1a-4cb8-897d-ebb45bede018 service nova] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:59.091365 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.compute.server_external_events [req-18b833cb-733c-4aec-b2f4-bd6aa6e61886 req-4cd0c6f2-3f1a-4cb8-897d-ebb45bede018 service nova] Creating event network-vif-deleted:42c9d1ca-e4ea-4f56-84c7-c0cc6675d404 for instance 3d02af20-1c93-4a68-a24d-8685406d9eb1 on hv-cinder-77642 Feb 19 05:03:59.097033 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [req-18b833cb-733c-4aec-b2f4-bd6aa6e61886 req-4cd0c6f2-3f1a-4cb8-897d-ebb45bede018 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075335 Feb 19 05:03:59.097879 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 300/589] 10.222.0.47 () {64 vars in 1308 bytes} [Fri Feb 19 05:03:59 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 05:03:59.149695 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-43e83dc0-c226-41b1-9814-6c005146d326 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:03:59.150949 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-43e83dc0-c226-41b1-9814-6c005146d326 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] [instance: be65ea57-bc8d-4bce-80c3-33d8b6007ed1] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:03:59.162363 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-43e83dc0-c226-41b1-9814-6c005146d326 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:59.168427 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-43e83dc0-c226-41b1-9814-6c005146d326 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:59.169780 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-43e83dc0-c226-41b1-9814-6c005146d326 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:59.178655 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-43e83dc0-c226-41b1-9814-6c005146d326 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:59.254112 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-f488141f-249e-4394-a8e0-801ce7cddaa0 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:03:59.255168 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-f488141f-249e-4394-a8e0-801ce7cddaa0 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] [instance: 74c5a115-b174-49fe-9b75-574e484a09e2] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:03:59.275668 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-f488141f-249e-4394-a8e0-801ce7cddaa0 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:59.285268 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-f488141f-249e-4394-a8e0-801ce7cddaa0 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:59.288647 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-f488141f-249e-4394-a8e0-801ce7cddaa0 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:59.289445 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-f488141f-249e-4394-a8e0-801ce7cddaa0 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:59.688351 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-43e83dc0-c226-41b1-9814-6c005146d326 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3274478c0a421895f43618dc827ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50941a0cab243e9a320ff22a7648de6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:03:59.704050 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-43e83dc0-c226-41b1-9814-6c005146d326 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] 10.222.0.47 "GET /compute/v2.1/servers/be65ea57-bc8d-4bce-80c3-33d8b6007ed1" status: 200 len: 1675 microversion: 2.1 time: 0.557622 Feb 19 05:03:59.705071 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 290/590] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:03:59 2021] GET /compute/v2.1/servers/be65ea57-bc8d-4bce-80c3-33d8b6007ed1 => generated 1675 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:03:59.710972 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [req-299d02df-0c98-4f3d-9f5b-73eafb51dae5 req-f15c9b1c-5c2b-412c-bda8-45e875c62e58 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b43c13a-0c7e-45d7-96b0-83fe593a8b08", "name": "network-vif-deleted", "tag": "bf7bd73f-da1c-4506-980b-db75cc18c728"}]} {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:03:59.713686 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 05:03:59.713686 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: warnings.warn(msg) Feb 19 05:03:59.727776 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [req-299d02df-0c98-4f3d-9f5b-73eafb51dae5 req-f15c9b1c-5c2b-412c-bda8-45e875c62e58 service nova] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:59.728360 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [req-299d02df-0c98-4f3d-9f5b-73eafb51dae5 req-f15c9b1c-5c2b-412c-bda8-45e875c62e58 service nova] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:59.749250 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.compute.server_external_events [req-299d02df-0c98-4f3d-9f5b-73eafb51dae5 req-f15c9b1c-5c2b-412c-bda8-45e875c62e58 service nova] Creating event network-vif-deleted:bf7bd73f-da1c-4506-980b-db75cc18c728 for instance 9b43c13a-0c7e-45d7-96b0-83fe593a8b08 on hv-cinder-77642 Feb 19 05:03:59.757002 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-f488141f-249e-4394-a8e0-801ce7cddaa0 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24af0562e2aa43ca9d601be5e16fe9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ee9a43087d5497da3af9fbf68c4572d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:03:59.761873 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [req-299d02df-0c98-4f3d-9f5b-73eafb51dae5 req-f15c9b1c-5c2b-412c-bda8-45e875c62e58 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054954 Feb 19 05:03:59.762533 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 291/591] 10.222.0.47 () {64 vars in 1308 bytes} [Fri Feb 19 05:03:59 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 05:03:59.768301 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-f488141f-249e-4394-a8e0-801ce7cddaa0 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] 10.222.0.47 "GET /compute/v2.1/servers/74c5a115-b174-49fe-9b75-574e484a09e2" status: 200 len: 1519 microversion: 2.1 time: 0.519110 Feb 19 05:03:59.769849 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-388e24d5-13ed-4913-8884-7c9282f9093b tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:03:59.770794 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-388e24d5-13ed-4913-8884-7c9282f9093b tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] [instance: be41f685-0cdd-4413-8467-43335bd91c60] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:03:59.779392 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 301/592] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:03:59 2021] GET /compute/v2.1/servers/74c5a115-b174-49fe-9b75-574e484a09e2 => generated 1519 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 05:03:59.780083 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-388e24d5-13ed-4913-8884-7c9282f9093b tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:59.780878 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-388e24d5-13ed-4913-8884-7c9282f9093b tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:59.781783 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-388e24d5-13ed-4913-8884-7c9282f9093b tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:03:59.782397 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-388e24d5-13ed-4913-8884-7c9282f9093b tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:03:59.836005 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-38711011-c2ba-4ed1-a408-725cf13ddcf4 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Action: 'create', calling method: .version_select at 0x7f27067f0950>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1088231285"}} {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:03:59.866842 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.quota [None req-38711011-c2ba-4ed1-a408-725cf13ddcf4 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Getting quotas for project 3309eb07e18a46a2a0bcbde1f9e46dd8. Resources: {'key_pairs'} {{(pid=98154) _get_quotas /opt/stack/nova/nova/quota.py:388}} Feb 19 05:03:59.874293 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.quota [None req-38711011-c2ba-4ed1-a408-725cf13ddcf4 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Getting quotas for user 5df26a2a7e854705800096f12d30c8b4 and project 3309eb07e18a46a2a0bcbde1f9e46dd8. Resources: {'key_pairs'} {{(pid=98154) _get_quotas /opt/stack/nova/nova/quota.py:380}} Feb 19 05:03:59.973012 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-388e24d5-13ed-4913-8884-7c9282f9093b tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '876d82b7755b4c1f91c8ad200c0f567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b461024d8cdf4d5c966d746682381d79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:03:59.987536 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-388e24d5-13ed-4913-8884-7c9282f9093b tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] 10.222.0.47 "GET /compute/v2.1/servers/be41f685-0cdd-4413-8467-43335bd91c60" status: 200 len: 1276 microversion: 2.1 time: 0.221872 Feb 19 05:03:59.996028 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 292/593] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:03:59 2021] GET /compute/v2.1/servers/be41f685-0cdd-4413-8467-43335bd91c60 => generated 1276 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:04:00.002123 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-83635baa-25fc-4d7e-bdd1-53667b301ab3 tempest-VolumesNegativeTest-1028193160 tempest-VolumesNegativeTest-1028193160-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:04:00.002810 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-83635baa-25fc-4d7e-bdd1-53667b301ab3 tempest-VolumesNegativeTest-1028193160 tempest-VolumesNegativeTest-1028193160-project] [instance: 3d02af20-1c93-4a68-a24d-8685406d9eb1] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:04:00.022150 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-83635baa-25fc-4d7e-bdd1-53667b301ab3 tempest-VolumesNegativeTest-1028193160 tempest-VolumesNegativeTest-1028193160-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:04:00.022668 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-83635baa-25fc-4d7e-bdd1-53667b301ab3 tempest-VolumesNegativeTest-1028193160 tempest-VolumesNegativeTest-1028193160-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:04:00.023569 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-83635baa-25fc-4d7e-bdd1-53667b301ab3 tempest-VolumesNegativeTest-1028193160 tempest-VolumesNegativeTest-1028193160-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:04:00.024070 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-83635baa-25fc-4d7e-bdd1-53667b301ab3 tempest-VolumesNegativeTest-1028193160 tempest-VolumesNegativeTest-1028193160-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:04:00.085779 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.wsgi [None req-83635baa-25fc-4d7e-bdd1-53667b301ab3 tempest-VolumesNegativeTest-1028193160 tempest-VolumesNegativeTest-1028193160-project] HTTP exception thrown: Instance 3d02af20-1c93-4a68-a24d-8685406d9eb1 could not be found. Feb 19 05:04:00.086697 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-83635baa-25fc-4d7e-bdd1-53667b301ab3 tempest-VolumesNegativeTest-1028193160 tempest-VolumesNegativeTest-1028193160-project] Returning 404 to user: Instance 3d02af20-1c93-4a68-a24d-8685406d9eb1 could not be found. {{(pid=98153) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 19 05:04:00.087839 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-83635baa-25fc-4d7e-bdd1-53667b301ab3 tempest-VolumesNegativeTest-1028193160 tempest-VolumesNegativeTest-1028193160-project] 10.222.0.47 "GET /compute/v2.1/servers/3d02af20-1c93-4a68-a24d-8685406d9eb1" status: 404 len: 111 microversion: 2.1 time: 0.090919 Feb 19 05:04:00.088886 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 293/594] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:03:59 2021] GET /compute/v2.1/servers/3d02af20-1c93-4a68-a24d-8685406d9eb1 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 05:04:00.094062 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-6f9c9ab4-d248-4403-9b0e-2da9d48e9f58 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:04:00.095005 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-6f9c9ab4-d248-4403-9b0e-2da9d48e9f58 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] [instance: 9b43c13a-0c7e-45d7-96b0-83fe593a8b08] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:04:00.103658 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-6f9c9ab4-d248-4403-9b0e-2da9d48e9f58 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:04:00.104174 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-6f9c9ab4-d248-4403-9b0e-2da9d48e9f58 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:04:00.105047 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-6f9c9ab4-d248-4403-9b0e-2da9d48e9f58 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:04:00.105544 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-6f9c9ab4-d248-4403-9b0e-2da9d48e9f58 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:04:00.199843 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-6f9c9ab4-d248-4403-9b0e-2da9d48e9f58 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:04:00.200435 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-6f9c9ab4-d248-4403-9b0e-2da9d48e9f58 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:04:00.200814 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.objects.instance [None req-6f9c9ab4-d248-4403-9b0e-2da9d48e9f58 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lazy-loading 'fault' on Instance uuid 9b43c13a-0c7e-45d7-96b0-83fe593a8b08 {{(pid=98153) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Feb 19 05:04:00.277029 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-6f9c9ab4-d248-4403-9b0e-2da9d48e9f58 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628d846121a14be78329ccc727c8869d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa473e12960449bbb0713a709e0abe4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:04:00.288554 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-6f9c9ab4-d248-4403-9b0e-2da9d48e9f58 tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] 10.222.0.47 "GET /compute/v2.1/servers/9b43c13a-0c7e-45d7-96b0-83fe593a8b08" status: 200 len: 1307 microversion: 2.1 time: 0.197991 Feb 19 05:04:00.289200 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 294/595] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:04:00 2021] GET /compute/v2.1/servers/9b43c13a-0c7e-45d7-96b0-83fe593a8b08 => generated 1307 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:04:00.549536 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.quota [None req-38711011-c2ba-4ed1-a408-725cf13ddcf4 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Getting quotas for project 3309eb07e18a46a2a0bcbde1f9e46dd8. Resources: {'key_pairs'} {{(pid=98154) _get_quotas /opt/stack/nova/nova/quota.py:388}} Feb 19 05:04:00.555986 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.quota [None req-38711011-c2ba-4ed1-a408-725cf13ddcf4 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Getting quotas for user 5df26a2a7e854705800096f12d30c8b4 and project 3309eb07e18a46a2a0bcbde1f9e46dd8. Resources: {'key_pairs'} {{(pid=98154) _get_quotas /opt/stack/nova/nova/quota.py:380}} Feb 19 05:04:00.577538 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-38711011-c2ba-4ed1-a408-725cf13ddcf4 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 2318 microversion: 2.1 time: 0.745404 Feb 19 05:04:00.579440 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 302/596] 10.222.0.47 () {60 vars in 1148 bytes} [Fri Feb 19 05:03:59 2021] POST /compute/v2.1/os-keypairs => generated 2318 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:04:00.641969 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-6137db4f-568d-4987-b4ed-6fabd8c2c753 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-61396478", "imageRef": "640bd260-ecdc-4577-b315-0b5cdfd82ffc", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1088231285", "networks": [{"uuid": "5cb4ec90-ce43-4ddc-ac74-490620baaffe"}]}} {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:04:00.716014 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.network.neutron [None req-6137db4f-568d-4987-b4ed-6fabd8c2c753 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] validate_networks() for [('5cb4ec90-ce43-4ddc-ac74-490620baaffe', None, None, None)] {{(pid=98153) validate_networks /opt/stack/nova/nova/network/neutron.py:2345}} Feb 19 05:04:00.727685 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-8010c1a3-aa88-4dec-a1c8-a294db280426 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:04:00.728576 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-8010c1a3-aa88-4dec-a1c8-a294db280426 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] [instance: be65ea57-bc8d-4bce-80c3-33d8b6007ed1] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:04:00.738356 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-8010c1a3-aa88-4dec-a1c8-a294db280426 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:04:00.739064 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-8010c1a3-aa88-4dec-a1c8-a294db280426 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:04:00.740165 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-8010c1a3-aa88-4dec-a1c8-a294db280426 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:04:00.740913 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-8010c1a3-aa88-4dec-a1c8-a294db280426 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:04:01.345419 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-8010c1a3-aa88-4dec-a1c8-a294db280426 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3274478c0a421895f43618dc827ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50941a0cab243e9a320ff22a7648de6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:04:01.357377 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-8010c1a3-aa88-4dec-a1c8-a294db280426 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] 10.222.0.47 "GET /compute/v2.1/servers/be65ea57-bc8d-4bce-80c3-33d8b6007ed1" status: 200 len: 1675 microversion: 2.1 time: 0.633545 Feb 19 05:04:01.359244 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 303/597] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:04:00 2021] GET /compute/v2.1/servers/be65ea57-bc8d-4bce-80c3-33d8b6007ed1 => generated 1675 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 05:04:01.374772 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-085c5d4e-01d1-4996-89c4-ad131a6961fe tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:04:01.375747 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-085c5d4e-01d1-4996-89c4-ad131a6961fe tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] [instance: 74c5a115-b174-49fe-9b75-574e484a09e2] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:04:01.384868 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-085c5d4e-01d1-4996-89c4-ad131a6961fe tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:04:01.385896 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-085c5d4e-01d1-4996-89c4-ad131a6961fe tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:04:01.386732 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-085c5d4e-01d1-4996-89c4-ad131a6961fe tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:04:01.387402 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-085c5d4e-01d1-4996-89c4-ad131a6961fe tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:04:01.847193 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-085c5d4e-01d1-4996-89c4-ad131a6961fe tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24af0562e2aa43ca9d601be5e16fe9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ee9a43087d5497da3af9fbf68c4572d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:04:01.854957 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.virt.hardware [None req-6137db4f-568d-4987-b4ed-6fabd8c2c753 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Flavor limits 0:0:0 {{(pid=98153) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 19 05:04:01.854957 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.virt.hardware [None req-6137db4f-568d-4987-b4ed-6fabd8c2c753 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Image limits 0:0:0 {{(pid=98153) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Feb 19 05:04:01.854957 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.virt.hardware [None req-6137db4f-568d-4987-b4ed-6fabd8c2c753 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Flavor pref 0:0:0 {{(pid=98153) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 19 05:04:01.855790 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.virt.hardware [None req-6137db4f-568d-4987-b4ed-6fabd8c2c753 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Image pref 0:0:0 {{(pid=98153) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Feb 19 05:04:01.856341 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.virt.hardware [None req-6137db4f-568d-4987-b4ed-6fabd8c2c753 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98153) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Feb 19 05:04:01.861425 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-085c5d4e-01d1-4996-89c4-ad131a6961fe tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] 10.222.0.47 "GET /compute/v2.1/servers/74c5a115-b174-49fe-9b75-574e484a09e2" status: 200 len: 1519 microversion: 2.1 time: 0.490426 Feb 19 05:04:01.867903 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 304/598] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:04:01 2021] GET /compute/v2.1/servers/74c5a115-b174-49fe-9b75-574e484a09e2 => generated 1519 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:04:01.868123 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-6137db4f-568d-4987-b4ed-6fabd8c2c753 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:04:01.868661 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-6137db4f-568d-4987-b4ed-6fabd8c2c753 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:04:01.869643 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-6137db4f-568d-4987-b4ed-6fabd8c2c753 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:04:01.870226 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-6137db4f-568d-4987-b4ed-6fabd8c2c753 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:04:01.881860 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-5a88372f-42f8-45b2-ae7a-89480cb918f9 tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:04:01.882528 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-5a88372f-42f8-45b2-ae7a-89480cb918f9 tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] [instance: be41f685-0cdd-4413-8467-43335bd91c60] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:04:01.892742 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-5a88372f-42f8-45b2-ae7a-89480cb918f9 tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:04:01.893259 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-5a88372f-42f8-45b2-ae7a-89480cb918f9 tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:04:01.893850 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.quota [None req-6137db4f-568d-4987-b4ed-6fabd8c2c753 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Getting quotas for project 3309eb07e18a46a2a0bcbde1f9e46dd8. Resources: {'instances', 'ram', 'cores'} {{(pid=98153) _get_quotas /opt/stack/nova/nova/quota.py:388}} Feb 19 05:04:01.894344 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-5a88372f-42f8-45b2-ae7a-89480cb918f9 tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:04:01.894884 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-5a88372f-42f8-45b2-ae7a-89480cb918f9 tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:04:01.909779 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.quota [None req-6137db4f-568d-4987-b4ed-6fabd8c2c753 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Getting quotas for user 5df26a2a7e854705800096f12d30c8b4 and project 3309eb07e18a46a2a0bcbde1f9e46dd8. Resources: {'instances', 'ram', 'cores'} {{(pid=98153) _get_quotas /opt/stack/nova/nova/quota.py:380}} Feb 19 05:04:01.923203 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-6137db4f-568d-4987-b4ed-6fabd8c2c753 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Going to run 1 instances... {{(pid=98153) _provision_instances /opt/stack/nova/nova/compute/api.py:1264}} Feb 19 05:04:01.962486 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-6137db4f-568d-4987-b4ed-6fabd8c2c753 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] [instance: 0ae0d266-c297-45f1-80fe-0e8f84cc22e6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='640bd260-ecdc-4577-b315-0b5cdfd82ffc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98153) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1666}} Feb 19 05:04:02.065084 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-6137db4f-568d-4987-b4ed-6fabd8c2c753 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.427622 Feb 19 05:04:02.065935 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 295/599] 10.222.0.47 () {60 vars in 1137 bytes} [Fri Feb 19 05:04:00 2021] POST /compute/v2.1/servers => generated 380 bytes in 1429 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 19 05:04:02.084239 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-cdef7f21-06bb-472c-b2c8-48065e68105d tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:04:02.085031 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-cdef7f21-06bb-472c-b2c8-48065e68105d tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] [instance: 9b43c13a-0c7e-45d7-96b0-83fe593a8b08] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:04:02.120564 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-cdef7f21-06bb-472c-b2c8-48065e68105d tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:04:02.121210 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-cdef7f21-06bb-472c-b2c8-48065e68105d tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:04:02.122110 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-cdef7f21-06bb-472c-b2c8-48065e68105d tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:04:02.126061 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-cdef7f21-06bb-472c-b2c8-48065e68105d tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:04:02.208767 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-5a88372f-42f8-45b2-ae7a-89480cb918f9 tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '876d82b7755b4c1f91c8ad200c0f567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b461024d8cdf4d5c966d746682381d79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:04:02.221154 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-5a88372f-42f8-45b2-ae7a-89480cb918f9 tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] 10.222.0.47 "GET /compute/v2.1/servers/be41f685-0cdd-4413-8467-43335bd91c60" status: 200 len: 1318 microversion: 2.1 time: 0.344382 Feb 19 05:04:02.226953 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 305/600] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:04:01 2021] GET /compute/v2.1/servers/be41f685-0cdd-4413-8467-43335bd91c60 => generated 1318 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:04:02.240947 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-d8c899ce-bb40-4bcb-a6dc-0775a03dcf42 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:04:02.241624 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-d8c899ce-bb40-4bcb-a6dc-0775a03dcf42 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] [instance: 0ae0d266-c297-45f1-80fe-0e8f84cc22e6] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:04:02.259249 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.wsgi [None req-cdef7f21-06bb-472c-b2c8-48065e68105d tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] HTTP exception thrown: Instance 9b43c13a-0c7e-45d7-96b0-83fe593a8b08 could not be found. Feb 19 05:04:02.260063 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-cdef7f21-06bb-472c-b2c8-48065e68105d tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] Returning 404 to user: Instance 9b43c13a-0c7e-45d7-96b0-83fe593a8b08 could not be found. {{(pid=98153) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 19 05:04:02.261413 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-cdef7f21-06bb-472c-b2c8-48065e68105d tempest-AttachVolumeNegativeTest-1175650652 tempest-AttachVolumeNegativeTest-1175650652-project] 10.222.0.47 "GET /compute/v2.1/servers/9b43c13a-0c7e-45d7-96b0-83fe593a8b08" status: 404 len: 111 microversion: 2.1 time: 0.194533 Feb 19 05:04:02.262181 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 296/601] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:04:02 2021] GET /compute/v2.1/servers/9b43c13a-0c7e-45d7-96b0-83fe593a8b08 => generated 111 bytes in 196 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 05:04:02.377929 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-7f2cf959-a0ec-4220-9482-ecc6f3cffa84 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:04:02.379452 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-7f2cf959-a0ec-4220-9482-ecc6f3cffa84 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] [instance: be65ea57-bc8d-4bce-80c3-33d8b6007ed1] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:04:02.396638 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-7f2cf959-a0ec-4220-9482-ecc6f3cffa84 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:04:02.397373 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-7f2cf959-a0ec-4220-9482-ecc6f3cffa84 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:04:02.398432 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-7f2cf959-a0ec-4220-9482-ecc6f3cffa84 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:04:02.399913 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-7f2cf959-a0ec-4220-9482-ecc6f3cffa84 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:04:02.416688 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-d8c899ce-bb40-4bcb-a6dc-0775a03dcf42 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5df26a2a7e854705800096f12d30c8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3309eb07e18a46a2a0bcbde1f9e46dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:04:02.426481 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-d8c899ce-bb40-4bcb-a6dc-0775a03dcf42 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] 10.222.0.47 "GET /compute/v2.1/servers/0ae0d266-c297-45f1-80fe-0e8f84cc22e6" status: 200 len: 1257 microversion: 2.1 time: 0.199584 Feb 19 05:04:02.427554 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 306/602] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:04:02 2021] GET /compute/v2.1/servers/0ae0d266-c297-45f1-80fe-0e8f84cc22e6 => generated 1257 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:04:02.436721 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [req-3e837854-bc2b-4535-9f76-c506837ccc69 req-40d1da03-e6e5-4b27-a322-1b699997d2e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "be41f685-0cdd-4413-8467-43335bd91c60", "tag": "39419b9e-6a2f-43bc-aa28-83a27266718d"}]} {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:04:02.442160 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 05:04:02.442160 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: warnings.warn(msg) Feb 19 05:04:02.453514 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [req-3e837854-bc2b-4535-9f76-c506837ccc69 req-40d1da03-e6e5-4b27-a322-1b699997d2e5 service nova] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:04:02.453924 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [req-3e837854-bc2b-4535-9f76-c506837ccc69 req-40d1da03-e6e5-4b27-a322-1b699997d2e5 service nova] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:04:02.491656 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.compute.server_external_events [req-3e837854-bc2b-4535-9f76-c506837ccc69 req-40d1da03-e6e5-4b27-a322-1b699997d2e5 service nova] Creating event network-changed:39419b9e-6a2f-43bc-aa28-83a27266718d for instance be41f685-0cdd-4413-8467-43335bd91c60 on hv-cinder-77642 Feb 19 05:04:02.498760 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [req-3e837854-bc2b-4535-9f76-c506837ccc69 req-40d1da03-e6e5-4b27-a322-1b699997d2e5 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068244 Feb 19 05:04:02.501640 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 307/603] 10.222.0.47 () {64 vars in 1308 bytes} [Fri Feb 19 05:04:02 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 05:04:02.888373 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-e32aef83-d7b9-4136-b111-b5ea6ae36bc0 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:04:02.893309 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-e32aef83-d7b9-4136-b111-b5ea6ae36bc0 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] [instance: 74c5a115-b174-49fe-9b75-574e484a09e2] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:04:02.912015 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-e32aef83-d7b9-4136-b111-b5ea6ae36bc0 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:04:02.912950 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-e32aef83-d7b9-4136-b111-b5ea6ae36bc0 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:04:02.920722 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-e32aef83-d7b9-4136-b111-b5ea6ae36bc0 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:04:02.921251 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-e32aef83-d7b9-4136-b111-b5ea6ae36bc0 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:04:02.932385 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-7f2cf959-a0ec-4220-9482-ecc6f3cffa84 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3274478c0a421895f43618dc827ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50941a0cab243e9a320ff22a7648de6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:04:02.974184 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-7f2cf959-a0ec-4220-9482-ecc6f3cffa84 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] 10.222.0.47 "GET /compute/v2.1/servers/be65ea57-bc8d-4bce-80c3-33d8b6007ed1" status: 200 len: 1675 microversion: 2.1 time: 0.600754 Feb 19 05:04:02.984642 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 297/604] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:04:02 2021] GET /compute/v2.1/servers/be65ea57-bc8d-4bce-80c3-33d8b6007ed1 => generated 1675 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:04:03.252055 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-5b87c582-bd79-41f7-8f08-ed34c464930e tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:04:03.252736 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-5b87c582-bd79-41f7-8f08-ed34c464930e tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] [instance: be41f685-0cdd-4413-8467-43335bd91c60] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:04:03.261113 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-5b87c582-bd79-41f7-8f08-ed34c464930e tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:04:03.261619 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-5b87c582-bd79-41f7-8f08-ed34c464930e tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:04:03.262477 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-5b87c582-bd79-41f7-8f08-ed34c464930e tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:04:03.262967 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-5b87c582-bd79-41f7-8f08-ed34c464930e tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:04:03.546644 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-e32aef83-d7b9-4136-b111-b5ea6ae36bc0 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24af0562e2aa43ca9d601be5e16fe9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ee9a43087d5497da3af9fbf68c4572d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:04:03.559988 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-e32aef83-d7b9-4136-b111-b5ea6ae36bc0 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] 10.222.0.47 "GET /compute/v2.1/servers/74c5a115-b174-49fe-9b75-574e484a09e2" status: 200 len: 1519 microversion: 2.1 time: 0.677706 Feb 19 05:04:03.560899 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 308/605] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:04:02 2021] GET /compute/v2.1/servers/74c5a115-b174-49fe-9b75-574e484a09e2 => generated 1519 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 05:04:03.566266 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-357bf317-5173-4bee-87fa-c29e6e5f8beb tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:04:03.567133 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-357bf317-5173-4bee-87fa-c29e6e5f8beb tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] [instance: 0ae0d266-c297-45f1-80fe-0e8f84cc22e6] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:04:03.576539 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-357bf317-5173-4bee-87fa-c29e6e5f8beb tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:04:03.577280 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-357bf317-5173-4bee-87fa-c29e6e5f8beb tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:04:03.579623 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-357bf317-5173-4bee-87fa-c29e6e5f8beb tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:04:03.580284 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-357bf317-5173-4bee-87fa-c29e6e5f8beb tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:04:03.843606 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-357bf317-5173-4bee-87fa-c29e6e5f8beb tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5df26a2a7e854705800096f12d30c8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3309eb07e18a46a2a0bcbde1f9e46dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:04:03.859195 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-357bf317-5173-4bee-87fa-c29e6e5f8beb tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] 10.222.0.47 "GET /compute/v2.1/servers/0ae0d266-c297-45f1-80fe-0e8f84cc22e6" status: 200 len: 1309 microversion: 2.1 time: 0.296952 Feb 19 05:04:03.859892 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 309/606] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:04:03 2021] GET /compute/v2.1/servers/0ae0d266-c297-45f1-80fe-0e8f84cc22e6 => generated 1309 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:04:04.004442 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-1ce17070-4aa8-4b92-91a0-b154fe1b0cb0 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:04:04.010647 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-1ce17070-4aa8-4b92-91a0-b154fe1b0cb0 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] [instance: be65ea57-bc8d-4bce-80c3-33d8b6007ed1] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:04:04.030224 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-1ce17070-4aa8-4b92-91a0-b154fe1b0cb0 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:04:04.033664 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-1ce17070-4aa8-4b92-91a0-b154fe1b0cb0 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:04:04.035429 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-1ce17070-4aa8-4b92-91a0-b154fe1b0cb0 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:04:04.036477 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-1ce17070-4aa8-4b92-91a0-b154fe1b0cb0 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:04:04.036835 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-5b87c582-bd79-41f7-8f08-ed34c464930e tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '876d82b7755b4c1f91c8ad200c0f567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b461024d8cdf4d5c966d746682381d79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:04:04.057853 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-5b87c582-bd79-41f7-8f08-ed34c464930e tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] 10.222.0.47 "GET /compute/v2.1/servers/be41f685-0cdd-4413-8467-43335bd91c60" status: 200 len: 1318 microversion: 2.1 time: 0.811620 Feb 19 05:04:04.058798 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 298/607] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:04:03 2021] GET /compute/v2.1/servers/be41f685-0cdd-4413-8467-43335bd91c60 => generated 1318 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:04:04.319251 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [req-722fd3b6-05d4-47a1-a511-49917d07005c req-c6349b5a-1aeb-4576-b0de-cb95ff6c85f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74c5a115-b174-49fe-9b75-574e484a09e2", "name": "network-vif-unplugged", "status": "completed", "tag": "8f7e187d-255a-42f5-82f0-109c4fec5aaa"}]} {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:04:04.321731 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 05:04:04.321731 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: warnings.warn(msg) Feb 19 05:04:04.331694 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [req-722fd3b6-05d4-47a1-a511-49917d07005c req-c6349b5a-1aeb-4576-b0de-cb95ff6c85f4 service nova] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:04:04.332762 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [req-722fd3b6-05d4-47a1-a511-49917d07005c req-c6349b5a-1aeb-4576-b0de-cb95ff6c85f4 service nova] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:04:04.352141 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.compute.server_external_events [req-722fd3b6-05d4-47a1-a511-49917d07005c req-c6349b5a-1aeb-4576-b0de-cb95ff6c85f4 service nova] Creating event network-vif-unplugged:8f7e187d-255a-42f5-82f0-109c4fec5aaa for instance 74c5a115-b174-49fe-9b75-574e484a09e2 on hv-cinder-77642 Feb 19 05:04:04.363173 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [req-722fd3b6-05d4-47a1-a511-49917d07005c req-c6349b5a-1aeb-4576-b0de-cb95ff6c85f4 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048000 Feb 19 05:04:04.364282 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 299/608] 10.222.0.47 () {64 vars in 1308 bytes} [Fri Feb 19 05:04:04 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 05:04:04.580629 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-e5c5147b-6b7e-48af-a103-da09d932c639 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:04:04.582122 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-e5c5147b-6b7e-48af-a103-da09d932c639 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] [instance: 74c5a115-b174-49fe-9b75-574e484a09e2] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:04:04.592370 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-e5c5147b-6b7e-48af-a103-da09d932c639 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:04:04.593714 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-e5c5147b-6b7e-48af-a103-da09d932c639 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:04:04.595082 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-e5c5147b-6b7e-48af-a103-da09d932c639 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:04:04.595959 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-e5c5147b-6b7e-48af-a103-da09d932c639 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:04:05.454840 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-1ce17070-4aa8-4b92-91a0-b154fe1b0cb0 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3274478c0a421895f43618dc827ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50941a0cab243e9a320ff22a7648de6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:04:05.464721 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-1ce17070-4aa8-4b92-91a0-b154fe1b0cb0 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] 10.222.0.47 "GET /compute/v2.1/servers/be65ea57-bc8d-4bce-80c3-33d8b6007ed1" status: 200 len: 1675 microversion: 2.1 time: 1.466372 Feb 19 05:04:05.476797 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 310/609] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:04:03 2021] GET /compute/v2.1/servers/be65ea57-bc8d-4bce-80c3-33d8b6007ed1 => generated 1675 bytes in 1479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:04:05.494002 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-bcba415c-51d1-46c6-9731-dda611201942 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:04:05.494869 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-bcba415c-51d1-46c6-9731-dda611201942 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] [instance: 0ae0d266-c297-45f1-80fe-0e8f84cc22e6] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:04:05.504592 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-bcba415c-51d1-46c6-9731-dda611201942 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:04:05.505100 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-bcba415c-51d1-46c6-9731-dda611201942 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:04:05.505954 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-bcba415c-51d1-46c6-9731-dda611201942 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:04:05.506746 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-bcba415c-51d1-46c6-9731-dda611201942 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:04:05.793547 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-e5c5147b-6b7e-48af-a103-da09d932c639 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24af0562e2aa43ca9d601be5e16fe9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ee9a43087d5497da3af9fbf68c4572d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:04:05.833365 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-e5c5147b-6b7e-48af-a103-da09d932c639 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] 10.222.0.47 "GET /compute/v2.1/servers/74c5a115-b174-49fe-9b75-574e484a09e2" status: 200 len: 1519 microversion: 2.1 time: 1.257235 Feb 19 05:04:05.840503 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 300/610] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:04:04 2021] GET /compute/v2.1/servers/74c5a115-b174-49fe-9b75-574e484a09e2 => generated 1519 bytes in 1267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 05:04:05.855801 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-f7cfee17-db15-40a0-9641-e862e78bd26f tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:04:05.863853 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-f7cfee17-db15-40a0-9641-e862e78bd26f tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] [instance: be41f685-0cdd-4413-8467-43335bd91c60] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:04:05.898283 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-f7cfee17-db15-40a0-9641-e862e78bd26f tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:04:05.900762 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-f7cfee17-db15-40a0-9641-e862e78bd26f tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:04:05.904109 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-f7cfee17-db15-40a0-9641-e862e78bd26f tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:04:05.905336 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-f7cfee17-db15-40a0-9641-e862e78bd26f tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:04:06.936563 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-bcba415c-51d1-46c6-9731-dda611201942 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5df26a2a7e854705800096f12d30c8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3309eb07e18a46a2a0bcbde1f9e46dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:04:06.962030 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-bcba415c-51d1-46c6-9731-dda611201942 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] 10.222.0.47 "GET /compute/v2.1/servers/0ae0d266-c297-45f1-80fe-0e8f84cc22e6" status: 200 len: 1357 microversion: 2.1 time: 1.483875 Feb 19 05:04:06.962693 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 311/611] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:04:05 2021] GET /compute/v2.1/servers/0ae0d266-c297-45f1-80fe-0e8f84cc22e6 => generated 1357 bytes in 1485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:04:06.974761 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-0d0ba49a-1e0c-4659-ad43-cda2d513f8a3 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:04:06.975496 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-0d0ba49a-1e0c-4659-ad43-cda2d513f8a3 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] [instance: be65ea57-bc8d-4bce-80c3-33d8b6007ed1] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:04:06.998403 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-0d0ba49a-1e0c-4659-ad43-cda2d513f8a3 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:04:06.998915 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-0d0ba49a-1e0c-4659-ad43-cda2d513f8a3 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:04:07.006708 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-0d0ba49a-1e0c-4659-ad43-cda2d513f8a3 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:04:07.006708 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-0d0ba49a-1e0c-4659-ad43-cda2d513f8a3 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:04:07.084912 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-f7cfee17-db15-40a0-9641-e862e78bd26f tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '876d82b7755b4c1f91c8ad200c0f567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b461024d8cdf4d5c966d746682381d79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:04:07.102276 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-f7cfee17-db15-40a0-9641-e862e78bd26f tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] 10.222.0.47 "GET /compute/v2.1/servers/be41f685-0cdd-4413-8467-43335bd91c60" status: 200 len: 1318 microversion: 2.1 time: 1.260100 Feb 19 05:04:07.115127 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 301/612] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:04:05 2021] GET /compute/v2.1/servers/be41f685-0cdd-4413-8467-43335bd91c60 => generated 1318 bytes in 1274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:04:07.120671 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-c379f1d5-cd98-48e5-85ca-a1f39fb64267 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:04:07.125092 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-c379f1d5-cd98-48e5-85ca-a1f39fb64267 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] [instance: 74c5a115-b174-49fe-9b75-574e484a09e2] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:04:07.163051 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-c379f1d5-cd98-48e5-85ca-a1f39fb64267 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:04:07.164185 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-c379f1d5-cd98-48e5-85ca-a1f39fb64267 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:04:07.172598 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-c379f1d5-cd98-48e5-85ca-a1f39fb64267 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:04:07.173548 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-c379f1d5-cd98-48e5-85ca-a1f39fb64267 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:04:07.471196 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-c379f1d5-cd98-48e5-85ca-a1f39fb64267 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24af0562e2aa43ca9d601be5e16fe9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ee9a43087d5497da3af9fbf68c4572d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:04:07.483580 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-c379f1d5-cd98-48e5-85ca-a1f39fb64267 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] 10.222.0.47 "GET /compute/v2.1/servers/74c5a115-b174-49fe-9b75-574e484a09e2" status: 200 len: 1477 microversion: 2.1 time: 0.367029 Feb 19 05:04:07.484637 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-0d0ba49a-1e0c-4659-ad43-cda2d513f8a3 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3274478c0a421895f43618dc827ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50941a0cab243e9a320ff22a7648de6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:04:07.488069 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 302/613] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:04:07 2021] GET /compute/v2.1/servers/74c5a115-b174-49fe-9b75-574e484a09e2 => generated 1477 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:04:07.496308 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [req-440223c3-7b5e-49bc-ae0c-ffa6b0bd7839 req-461f85c6-fc0a-45c8-8e7c-1cb57953f88f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74c5a115-b174-49fe-9b75-574e484a09e2", "name": "network-vif-deleted", "tag": "8f7e187d-255a-42f5-82f0-109c4fec5aaa"}]} {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:04:07.498300 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 05:04:07.498300 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: warnings.warn(msg) Feb 19 05:04:07.507943 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [req-440223c3-7b5e-49bc-ae0c-ffa6b0bd7839 req-461f85c6-fc0a-45c8-8e7c-1cb57953f88f service nova] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:04:07.508502 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-0d0ba49a-1e0c-4659-ad43-cda2d513f8a3 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] 10.222.0.47 "GET /compute/v2.1/servers/be65ea57-bc8d-4bce-80c3-33d8b6007ed1" status: 200 len: 1675 microversion: 2.1 time: 0.544659 Feb 19 05:04:07.509019 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [req-440223c3-7b5e-49bc-ae0c-ffa6b0bd7839 req-461f85c6-fc0a-45c8-8e7c-1cb57953f88f service nova] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:04:07.509139 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 312/614] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:04:06 2021] GET /compute/v2.1/servers/be65ea57-bc8d-4bce-80c3-33d8b6007ed1 => generated 1675 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:04:07.527615 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.compute.server_external_events [req-440223c3-7b5e-49bc-ae0c-ffa6b0bd7839 req-461f85c6-fc0a-45c8-8e7c-1cb57953f88f service nova] Creating event network-vif-deleted:8f7e187d-255a-42f5-82f0-109c4fec5aaa for instance 74c5a115-b174-49fe-9b75-574e484a09e2 on hv-cinder-77642 Feb 19 05:04:07.533477 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [req-440223c3-7b5e-49bc-ae0c-ffa6b0bd7839 req-461f85c6-fc0a-45c8-8e7c-1cb57953f88f service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043862 Feb 19 05:04:07.534216 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 303/615] 10.222.0.47 () {64 vars in 1308 bytes} [Fri Feb 19 05:04:07 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 05:04:07.985662 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-977573c0-2de0-413a-8866-70976ef0464f tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:04:07.986836 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-977573c0-2de0-413a-8866-70976ef0464f tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] [instance: 0ae0d266-c297-45f1-80fe-0e8f84cc22e6] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:04:07.996231 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-977573c0-2de0-413a-8866-70976ef0464f tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:04:07.996926 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-977573c0-2de0-413a-8866-70976ef0464f tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:04:07.997856 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-977573c0-2de0-413a-8866-70976ef0464f tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:04:07.998527 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-977573c0-2de0-413a-8866-70976ef0464f tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:04:08.134752 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-961b83ac-0e49-45ec-be43-6199040892e7 tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:04:08.135766 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-961b83ac-0e49-45ec-be43-6199040892e7 tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] [instance: be41f685-0cdd-4413-8467-43335bd91c60] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:04:08.145183 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-961b83ac-0e49-45ec-be43-6199040892e7 tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:04:08.145669 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-961b83ac-0e49-45ec-be43-6199040892e7 tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:04:08.146759 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-961b83ac-0e49-45ec-be43-6199040892e7 tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:04:08.147244 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-961b83ac-0e49-45ec-be43-6199040892e7 tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:04:08.336375 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-977573c0-2de0-413a-8866-70976ef0464f tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5df26a2a7e854705800096f12d30c8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3309eb07e18a46a2a0bcbde1f9e46dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:04:08.353051 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-977573c0-2de0-413a-8866-70976ef0464f tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] 10.222.0.47 "GET /compute/v2.1/servers/0ae0d266-c297-45f1-80fe-0e8f84cc22e6" status: 200 len: 1357 microversion: 2.1 time: 0.374590 Feb 19 05:04:08.353699 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 313/616] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:04:07 2021] GET /compute/v2.1/servers/0ae0d266-c297-45f1-80fe-0e8f84cc22e6 => generated 1357 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:04:08.475290 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-961b83ac-0e49-45ec-be43-6199040892e7 tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '876d82b7755b4c1f91c8ad200c0f567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b461024d8cdf4d5c966d746682381d79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:04:08.496611 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-961b83ac-0e49-45ec-be43-6199040892e7 tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] 10.222.0.47 "GET /compute/v2.1/servers/be41f685-0cdd-4413-8467-43335bd91c60" status: 200 len: 1318 microversion: 2.1 time: 0.365779 Feb 19 05:04:08.497810 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 304/617] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:04:08 2021] GET /compute/v2.1/servers/be41f685-0cdd-4413-8467-43335bd91c60 => generated 1318 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:04:08.512601 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-b2a63ace-1338-4733-98fb-9003315aa617 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:04:08.513806 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-b2a63ace-1338-4733-98fb-9003315aa617 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] [instance: 74c5a115-b174-49fe-9b75-574e484a09e2] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:04:08.529611 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-828d6c5c-20e7-4652-8893-2b4652f35ac5 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:04:08.530238 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-b2a63ace-1338-4733-98fb-9003315aa617 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:04:08.531230 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-828d6c5c-20e7-4652-8893-2b4652f35ac5 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] [instance: be65ea57-bc8d-4bce-80c3-33d8b6007ed1] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:04:08.533257 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-b2a63ace-1338-4733-98fb-9003315aa617 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:04:08.535491 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-b2a63ace-1338-4733-98fb-9003315aa617 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:04:08.536543 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-b2a63ace-1338-4733-98fb-9003315aa617 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:04:08.542846 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-828d6c5c-20e7-4652-8893-2b4652f35ac5 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:04:08.543516 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-828d6c5c-20e7-4652-8893-2b4652f35ac5 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:04:08.545130 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-828d6c5c-20e7-4652-8893-2b4652f35ac5 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:04:08.546228 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-828d6c5c-20e7-4652-8893-2b4652f35ac5 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:04:08.769594 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-b2a63ace-1338-4733-98fb-9003315aa617 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24af0562e2aa43ca9d601be5e16fe9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ee9a43087d5497da3af9fbf68c4572d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:04:08.779601 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-b2a63ace-1338-4733-98fb-9003315aa617 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] 10.222.0.47 "GET /compute/v2.1/servers/74c5a115-b174-49fe-9b75-574e484a09e2" status: 200 len: 1477 microversion: 2.1 time: 0.275946 Feb 19 05:04:08.780333 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 314/618] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:04:08 2021] GET /compute/v2.1/servers/74c5a115-b174-49fe-9b75-574e484a09e2 => generated 1477 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:04:09.178885 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-828d6c5c-20e7-4652-8893-2b4652f35ac5 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3274478c0a421895f43618dc827ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50941a0cab243e9a320ff22a7648de6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:04:09.191683 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-828d6c5c-20e7-4652-8893-2b4652f35ac5 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] 10.222.0.47 "GET /compute/v2.1/servers/be65ea57-bc8d-4bce-80c3-33d8b6007ed1" status: 200 len: 1675 microversion: 2.1 time: 0.667439 Feb 19 05:04:09.192818 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 305/619] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:04:08 2021] GET /compute/v2.1/servers/be65ea57-bc8d-4bce-80c3-33d8b6007ed1 => generated 1675 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 05:04:09.375863 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-c9efeb66-d7c0-48c7-9803-73ea78c0b939 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:04:09.377081 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-c9efeb66-d7c0-48c7-9803-73ea78c0b939 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] [instance: 0ae0d266-c297-45f1-80fe-0e8f84cc22e6] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:04:09.387490 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-c9efeb66-d7c0-48c7-9803-73ea78c0b939 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:04:09.389933 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-c9efeb66-d7c0-48c7-9803-73ea78c0b939 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:04:09.391931 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-c9efeb66-d7c0-48c7-9803-73ea78c0b939 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:04:09.392913 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-c9efeb66-d7c0-48c7-9803-73ea78c0b939 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:04:09.525386 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-f16ccfa2-9883-488d-8c90-e7b11002ff72 tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:04:09.531166 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-f16ccfa2-9883-488d-8c90-e7b11002ff72 tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] [instance: be41f685-0cdd-4413-8467-43335bd91c60] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:04:09.555793 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-f16ccfa2-9883-488d-8c90-e7b11002ff72 tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:04:09.557360 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-f16ccfa2-9883-488d-8c90-e7b11002ff72 tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:04:09.559551 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-f16ccfa2-9883-488d-8c90-e7b11002ff72 tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:04:09.560284 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-f16ccfa2-9883-488d-8c90-e7b11002ff72 tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:04:09.702102 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-c9efeb66-d7c0-48c7-9803-73ea78c0b939 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5df26a2a7e854705800096f12d30c8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3309eb07e18a46a2a0bcbde1f9e46dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:04:09.724459 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-c9efeb66-d7c0-48c7-9803-73ea78c0b939 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] 10.222.0.47 "GET /compute/v2.1/servers/0ae0d266-c297-45f1-80fe-0e8f84cc22e6" status: 200 len: 1357 microversion: 2.1 time: 0.353486 Feb 19 05:04:09.725031 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 315/620] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:04:09 2021] GET /compute/v2.1/servers/0ae0d266-c297-45f1-80fe-0e8f84cc22e6 => generated 1357 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:04:09.800519 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-6370532a-d613-4ad7-9a17-441a47eddf03 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:04:09.801030 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-6370532a-d613-4ad7-9a17-441a47eddf03 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] [instance: 74c5a115-b174-49fe-9b75-574e484a09e2] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:04:09.810000 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-6370532a-d613-4ad7-9a17-441a47eddf03 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:04:09.810932 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-6370532a-d613-4ad7-9a17-441a47eddf03 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:04:09.812386 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-6370532a-d613-4ad7-9a17-441a47eddf03 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:04:09.813308 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-6370532a-d613-4ad7-9a17-441a47eddf03 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:04:09.916563 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-f16ccfa2-9883-488d-8c90-e7b11002ff72 tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '876d82b7755b4c1f91c8ad200c0f567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b461024d8cdf4d5c966d746682381d79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:04:09.931281 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-f16ccfa2-9883-488d-8c90-e7b11002ff72 tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] 10.222.0.47 "GET /compute/v2.1/servers/be41f685-0cdd-4413-8467-43335bd91c60" status: 200 len: 1318 microversion: 2.1 time: 0.416564 Feb 19 05:04:09.932173 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 306/621] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:04:09 2021] GET /compute/v2.1/servers/be41f685-0cdd-4413-8467-43335bd91c60 => generated 1318 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 05:04:10.041981 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-6370532a-d613-4ad7-9a17-441a47eddf03 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24af0562e2aa43ca9d601be5e16fe9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ee9a43087d5497da3af9fbf68c4572d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:04:10.053517 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-6370532a-d613-4ad7-9a17-441a47eddf03 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] 10.222.0.47 "GET /compute/v2.1/servers/74c5a115-b174-49fe-9b75-574e484a09e2" status: 200 len: 1477 microversion: 2.1 time: 0.257541 Feb 19 05:04:10.054520 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 316/622] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:04:09 2021] GET /compute/v2.1/servers/74c5a115-b174-49fe-9b75-574e484a09e2 => generated 1477 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:04:10.210954 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-e59e5f76-ea0e-4860-bade-ff8221fc4897 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:04:10.211778 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-e59e5f76-ea0e-4860-bade-ff8221fc4897 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] [instance: be65ea57-bc8d-4bce-80c3-33d8b6007ed1] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:04:10.220492 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-e59e5f76-ea0e-4860-bade-ff8221fc4897 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:04:10.220993 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-e59e5f76-ea0e-4860-bade-ff8221fc4897 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:04:10.221854 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-e59e5f76-ea0e-4860-bade-ff8221fc4897 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:04:10.222339 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-e59e5f76-ea0e-4860-bade-ff8221fc4897 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:04:10.636862 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-e59e5f76-ea0e-4860-bade-ff8221fc4897 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3274478c0a421895f43618dc827ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50941a0cab243e9a320ff22a7648de6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:04:10.648407 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-e59e5f76-ea0e-4860-bade-ff8221fc4897 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] 10.222.0.47 "GET /compute/v2.1/servers/be65ea57-bc8d-4bce-80c3-33d8b6007ed1" status: 200 len: 1675 microversion: 2.1 time: 0.441904 Feb 19 05:04:10.649404 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 307/623] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:04:10 2021] GET /compute/v2.1/servers/be65ea57-bc8d-4bce-80c3-33d8b6007ed1 => generated 1675 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:04:10.742816 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-a243b5c5-5b19-46a7-a65d-6830fe6ffc6c tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:04:10.743793 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-a243b5c5-5b19-46a7-a65d-6830fe6ffc6c tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] [instance: 0ae0d266-c297-45f1-80fe-0e8f84cc22e6] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:04:10.752271 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-a243b5c5-5b19-46a7-a65d-6830fe6ffc6c tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:04:10.752780 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-a243b5c5-5b19-46a7-a65d-6830fe6ffc6c tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:04:10.753630 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-a243b5c5-5b19-46a7-a65d-6830fe6ffc6c tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:04:10.754119 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-a243b5c5-5b19-46a7-a65d-6830fe6ffc6c tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:04:10.962478 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-0c6b99d6-9343-43ea-acfb-29ab31da1dc7 tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:04:10.963654 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-0c6b99d6-9343-43ea-acfb-29ab31da1dc7 tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] [instance: be41f685-0cdd-4413-8467-43335bd91c60] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:04:11.004411 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-0c6b99d6-9343-43ea-acfb-29ab31da1dc7 tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:04:11.007201 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-0c6b99d6-9343-43ea-acfb-29ab31da1dc7 tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:04:11.008368 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-0c6b99d6-9343-43ea-acfb-29ab31da1dc7 tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:04:11.010727 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-0c6b99d6-9343-43ea-acfb-29ab31da1dc7 tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:04:11.078316 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-a243b5c5-5b19-46a7-a65d-6830fe6ffc6c tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5df26a2a7e854705800096f12d30c8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3309eb07e18a46a2a0bcbde1f9e46dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:04:11.102824 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-a243b5c5-5b19-46a7-a65d-6830fe6ffc6c tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] 10.222.0.47 "GET /compute/v2.1/servers/0ae0d266-c297-45f1-80fe-0e8f84cc22e6" status: 200 len: 1357 microversion: 2.1 time: 0.352698 Feb 19 05:04:11.102824 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 317/624] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:04:10 2021] GET /compute/v2.1/servers/0ae0d266-c297-45f1-80fe-0e8f84cc22e6 => generated 1357 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:04:11.102824 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-35807472-48d2-49ac-b029-e82494f813ca tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:04:11.103706 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-35807472-48d2-49ac-b029-e82494f813ca tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] [instance: 74c5a115-b174-49fe-9b75-574e484a09e2] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:04:11.116773 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-35807472-48d2-49ac-b029-e82494f813ca tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:04:11.117281 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-35807472-48d2-49ac-b029-e82494f813ca tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:04:11.118143 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-35807472-48d2-49ac-b029-e82494f813ca tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:04:11.118690 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-35807472-48d2-49ac-b029-e82494f813ca tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:04:11.340392 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-35807472-48d2-49ac-b029-e82494f813ca tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24af0562e2aa43ca9d601be5e16fe9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ee9a43087d5497da3af9fbf68c4572d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:04:11.350805 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-35807472-48d2-49ac-b029-e82494f813ca tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] 10.222.0.47 "GET /compute/v2.1/servers/74c5a115-b174-49fe-9b75-574e484a09e2" status: 200 len: 1477 microversion: 2.1 time: 0.255231 Feb 19 05:04:11.351681 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 318/625] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:04:11 2021] GET /compute/v2.1/servers/74c5a115-b174-49fe-9b75-574e484a09e2 => generated 1477 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:04:11.448690 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-0c6b99d6-9343-43ea-acfb-29ab31da1dc7 tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '876d82b7755b4c1f91c8ad200c0f567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b461024d8cdf4d5c966d746682381d79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:04:11.464803 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-0c6b99d6-9343-43ea-acfb-29ab31da1dc7 tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] 10.222.0.47 "GET /compute/v2.1/servers/be41f685-0cdd-4413-8467-43335bd91c60" status: 200 len: 1318 microversion: 2.1 time: 0.509518 Feb 19 05:04:11.467487 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 308/626] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:04:10 2021] GET /compute/v2.1/servers/be41f685-0cdd-4413-8467-43335bd91c60 => generated 1318 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:04:11.681747 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-0100354c-9cf9-4aab-9f0d-a21ddd866d25 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:04:11.683048 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-0100354c-9cf9-4aab-9f0d-a21ddd866d25 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] [instance: be65ea57-bc8d-4bce-80c3-33d8b6007ed1] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:04:11.701536 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-0100354c-9cf9-4aab-9f0d-a21ddd866d25 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:04:11.702504 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-0100354c-9cf9-4aab-9f0d-a21ddd866d25 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:04:11.704107 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-0100354c-9cf9-4aab-9f0d-a21ddd866d25 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:04:11.704999 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-0100354c-9cf9-4aab-9f0d-a21ddd866d25 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:04:12.098601 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-0100354c-9cf9-4aab-9f0d-a21ddd866d25 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3274478c0a421895f43618dc827ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50941a0cab243e9a320ff22a7648de6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:04:12.110005 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-0100354c-9cf9-4aab-9f0d-a21ddd866d25 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] 10.222.0.47 "GET /compute/v2.1/servers/be65ea57-bc8d-4bce-80c3-33d8b6007ed1" status: 200 len: 1675 microversion: 2.1 time: 0.437049 Feb 19 05:04:12.110889 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 319/627] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:04:11 2021] GET /compute/v2.1/servers/be65ea57-bc8d-4bce-80c3-33d8b6007ed1 => generated 1675 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:04:12.111013 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-e1faccbd-77b7-4576-8c8c-7bdea2fe5eee tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:04:12.111626 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-e1faccbd-77b7-4576-8c8c-7bdea2fe5eee tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] [instance: 0ae0d266-c297-45f1-80fe-0e8f84cc22e6] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:04:12.121419 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-e1faccbd-77b7-4576-8c8c-7bdea2fe5eee tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:04:12.122150 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-e1faccbd-77b7-4576-8c8c-7bdea2fe5eee tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:04:12.123176 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-e1faccbd-77b7-4576-8c8c-7bdea2fe5eee tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:04:12.123715 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-e1faccbd-77b7-4576-8c8c-7bdea2fe5eee tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:04:12.370008 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-20d0d4b8-b536-4f4e-b185-257b9764f5c4 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:04:12.370677 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-20d0d4b8-b536-4f4e-b185-257b9764f5c4 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] [instance: 74c5a115-b174-49fe-9b75-574e484a09e2] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:04:12.392895 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-e1faccbd-77b7-4576-8c8c-7bdea2fe5eee tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5df26a2a7e854705800096f12d30c8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3309eb07e18a46a2a0bcbde1f9e46dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:04:12.393088 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-20d0d4b8-b536-4f4e-b185-257b9764f5c4 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:04:12.393600 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-20d0d4b8-b536-4f4e-b185-257b9764f5c4 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:04:12.394470 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-20d0d4b8-b536-4f4e-b185-257b9764f5c4 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:04:12.399907 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-20d0d4b8-b536-4f4e-b185-257b9764f5c4 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:04:12.403799 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-e1faccbd-77b7-4576-8c8c-7bdea2fe5eee tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] 10.222.0.47 "GET /compute/v2.1/servers/0ae0d266-c297-45f1-80fe-0e8f84cc22e6" status: 200 len: 1357 microversion: 2.1 time: 0.297037 Feb 19 05:04:12.404532 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 309/628] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:04:12 2021] GET /compute/v2.1/servers/0ae0d266-c297-45f1-80fe-0e8f84cc22e6 => generated 1357 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:04:12.492909 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-48fa5e84-63b0-44f4-8f4e-d76f668f613e tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:04:12.494212 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-48fa5e84-63b0-44f4-8f4e-d76f668f613e tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] [instance: be41f685-0cdd-4413-8467-43335bd91c60] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:04:12.526448 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-48fa5e84-63b0-44f4-8f4e-d76f668f613e tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:04:12.528016 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-48fa5e84-63b0-44f4-8f4e-d76f668f613e tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:04:12.529147 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-48fa5e84-63b0-44f4-8f4e-d76f668f613e tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:04:12.529749 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-48fa5e84-63b0-44f4-8f4e-d76f668f613e tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:04:12.567140 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-20d0d4b8-b536-4f4e-b185-257b9764f5c4 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24af0562e2aa43ca9d601be5e16fe9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ee9a43087d5497da3af9fbf68c4572d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:04:12.581519 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-20d0d4b8-b536-4f4e-b185-257b9764f5c4 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] 10.222.0.47 "GET /compute/v2.1/servers/74c5a115-b174-49fe-9b75-574e484a09e2" status: 200 len: 1477 microversion: 2.1 time: 0.215162 Feb 19 05:04:12.582185 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 320/629] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:04:12 2021] GET /compute/v2.1/servers/74c5a115-b174-49fe-9b75-574e484a09e2 => generated 1477 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:04:12.904105 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-48fa5e84-63b0-44f4-8f4e-d76f668f613e tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '876d82b7755b4c1f91c8ad200c0f567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b461024d8cdf4d5c966d746682381d79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:04:12.917223 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-48fa5e84-63b0-44f4-8f4e-d76f668f613e tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] 10.222.0.47 "GET /compute/v2.1/servers/be41f685-0cdd-4413-8467-43335bd91c60" status: 200 len: 1318 microversion: 2.1 time: 0.434985 Feb 19 05:04:12.917890 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 310/630] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:04:12 2021] GET /compute/v2.1/servers/be41f685-0cdd-4413-8467-43335bd91c60 => generated 1318 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:04:13.129572 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-9c43f516-1d2a-405e-b9a2-b865171f2e6d tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:04:13.130194 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-9c43f516-1d2a-405e-b9a2-b865171f2e6d tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] [instance: be65ea57-bc8d-4bce-80c3-33d8b6007ed1] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:04:13.139465 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-9c43f516-1d2a-405e-b9a2-b865171f2e6d tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:04:13.140113 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-9c43f516-1d2a-405e-b9a2-b865171f2e6d tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:04:13.141381 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-9c43f516-1d2a-405e-b9a2-b865171f2e6d tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:04:13.141910 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-9c43f516-1d2a-405e-b9a2-b865171f2e6d tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:04:13.424440 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-4220253c-6506-47e5-b094-b153245a4698 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:04:13.425169 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-4220253c-6506-47e5-b094-b153245a4698 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] [instance: 0ae0d266-c297-45f1-80fe-0e8f84cc22e6] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:04:13.433716 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-9c43f516-1d2a-405e-b9a2-b865171f2e6d tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3274478c0a421895f43618dc827ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50941a0cab243e9a320ff22a7648de6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:04:13.445918 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-4220253c-6506-47e5-b094-b153245a4698 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:04:13.448312 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-4220253c-6506-47e5-b094-b153245a4698 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:04:13.449324 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-4220253c-6506-47e5-b094-b153245a4698 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:04:13.449866 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-4220253c-6506-47e5-b094-b153245a4698 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:04:13.458466 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-9c43f516-1d2a-405e-b9a2-b865171f2e6d tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] 10.222.0.47 "GET /compute/v2.1/servers/be65ea57-bc8d-4bce-80c3-33d8b6007ed1" status: 200 len: 1675 microversion: 2.1 time: 0.333482 Feb 19 05:04:13.461119 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 321/631] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:04:13 2021] GET /compute/v2.1/servers/be65ea57-bc8d-4bce-80c3-33d8b6007ed1 => generated 1675 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:04:13.608471 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-0a767313-78b0-4ab3-aa5f-f1b485ca5035 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:04:13.610406 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-0a767313-78b0-4ab3-aa5f-f1b485ca5035 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] [instance: 74c5a115-b174-49fe-9b75-574e484a09e2] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:04:13.620836 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-0a767313-78b0-4ab3-aa5f-f1b485ca5035 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:04:13.621304 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-0a767313-78b0-4ab3-aa5f-f1b485ca5035 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:04:13.622378 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-0a767313-78b0-4ab3-aa5f-f1b485ca5035 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:04:13.622963 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-0a767313-78b0-4ab3-aa5f-f1b485ca5035 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:04:13.806196 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-0a767313-78b0-4ab3-aa5f-f1b485ca5035 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24af0562e2aa43ca9d601be5e16fe9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ee9a43087d5497da3af9fbf68c4572d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:04:13.815790 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-0a767313-78b0-4ab3-aa5f-f1b485ca5035 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] 10.222.0.47 "GET /compute/v2.1/servers/74c5a115-b174-49fe-9b75-574e484a09e2" status: 200 len: 1477 microversion: 2.1 time: 0.212078 Feb 19 05:04:13.817052 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 322/632] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:04:13 2021] GET /compute/v2.1/servers/74c5a115-b174-49fe-9b75-574e484a09e2 => generated 1477 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 05:04:13.832576 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-4220253c-6506-47e5-b094-b153245a4698 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5df26a2a7e854705800096f12d30c8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3309eb07e18a46a2a0bcbde1f9e46dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:04:13.842179 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-4220253c-6506-47e5-b094-b153245a4698 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] 10.222.0.47 "GET /compute/v2.1/servers/0ae0d266-c297-45f1-80fe-0e8f84cc22e6" status: 200 len: 1357 microversion: 2.1 time: 0.423483 Feb 19 05:04:13.847672 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 311/633] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:04:13 2021] GET /compute/v2.1/servers/0ae0d266-c297-45f1-80fe-0e8f84cc22e6 => generated 1357 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:04:13.938076 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-8c1ee292-9e4f-4a60-8b2e-b6f0f5641a30 tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:04:13.939115 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-8c1ee292-9e4f-4a60-8b2e-b6f0f5641a30 tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] [instance: be41f685-0cdd-4413-8467-43335bd91c60] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:04:13.956369 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-8c1ee292-9e4f-4a60-8b2e-b6f0f5641a30 tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:04:13.957234 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-8c1ee292-9e4f-4a60-8b2e-b6f0f5641a30 tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:04:13.958280 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-8c1ee292-9e4f-4a60-8b2e-b6f0f5641a30 tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:04:13.958981 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-8c1ee292-9e4f-4a60-8b2e-b6f0f5641a30 tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:04:14.257114 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-8c1ee292-9e4f-4a60-8b2e-b6f0f5641a30 tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '876d82b7755b4c1f91c8ad200c0f567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b461024d8cdf4d5c966d746682381d79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:04:14.275822 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-8c1ee292-9e4f-4a60-8b2e-b6f0f5641a30 tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] 10.222.0.47 "GET /compute/v2.1/servers/be41f685-0cdd-4413-8467-43335bd91c60" status: 200 len: 1318 microversion: 2.1 time: 0.342501 Feb 19 05:04:14.276946 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 323/634] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:04:13 2021] GET /compute/v2.1/servers/be41f685-0cdd-4413-8467-43335bd91c60 => generated 1318 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:04:14.486824 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-4e2e12ec-0e17-4d21-8532-957466526de5 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:04:14.489981 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-4e2e12ec-0e17-4d21-8532-957466526de5 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] [instance: be65ea57-bc8d-4bce-80c3-33d8b6007ed1] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:04:14.500341 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-4e2e12ec-0e17-4d21-8532-957466526de5 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:04:14.501126 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-4e2e12ec-0e17-4d21-8532-957466526de5 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:04:14.502210 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-4e2e12ec-0e17-4d21-8532-957466526de5 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:04:14.502893 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-4e2e12ec-0e17-4d21-8532-957466526de5 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:04:14.841781 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-ff08a942-8c8b-48d2-a094-a2c9a078c1c6 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:04:14.842457 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-ff08a942-8c8b-48d2-a094-a2c9a078c1c6 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] [instance: 74c5a115-b174-49fe-9b75-574e484a09e2] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:04:14.851939 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-ff08a942-8c8b-48d2-a094-a2c9a078c1c6 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:04:14.852450 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-ff08a942-8c8b-48d2-a094-a2c9a078c1c6 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:04:14.853323 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-ff08a942-8c8b-48d2-a094-a2c9a078c1c6 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:04:14.853818 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-ff08a942-8c8b-48d2-a094-a2c9a078c1c6 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:04:14.941406 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-4e2e12ec-0e17-4d21-8532-957466526de5 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3274478c0a421895f43618dc827ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50941a0cab243e9a320ff22a7648de6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:04:14.985149 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-4e2e12ec-0e17-4d21-8532-957466526de5 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] 10.222.0.47 "GET /compute/v2.1/servers/be65ea57-bc8d-4bce-80c3-33d8b6007ed1" status: 200 len: 1675 microversion: 2.1 time: 0.487444 Feb 19 05:04:15.019383 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 312/635] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:04:14 2021] GET /compute/v2.1/servers/be65ea57-bc8d-4bce-80c3-33d8b6007ed1 => generated 1675 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:04:15.034912 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-4620baac-edb6-4d0d-8eb5-be39a2218bc2 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:04:15.044726 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-4620baac-edb6-4d0d-8eb5-be39a2218bc2 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] [instance: 0ae0d266-c297-45f1-80fe-0e8f84cc22e6] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:04:15.078053 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-4620baac-edb6-4d0d-8eb5-be39a2218bc2 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:04:15.079003 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-4620baac-edb6-4d0d-8eb5-be39a2218bc2 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:04:15.080692 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-4620baac-edb6-4d0d-8eb5-be39a2218bc2 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:04:15.081627 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-4620baac-edb6-4d0d-8eb5-be39a2218bc2 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:04:15.113868 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-ff08a942-8c8b-48d2-a094-a2c9a078c1c6 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24af0562e2aa43ca9d601be5e16fe9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ee9a43087d5497da3af9fbf68c4572d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:04:15.141453 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-ff08a942-8c8b-48d2-a094-a2c9a078c1c6 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] 10.222.0.47 "GET /compute/v2.1/servers/74c5a115-b174-49fe-9b75-574e484a09e2" status: 200 len: 1477 microversion: 2.1 time: 0.293191 Feb 19 05:04:15.142584 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 324/636] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:04:14 2021] GET /compute/v2.1/servers/74c5a115-b174-49fe-9b75-574e484a09e2 => generated 1477 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:04:15.332974 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-8a7d3477-8721-4894-a158-80edf9dedbac tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:04:15.335724 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-8a7d3477-8721-4894-a158-80edf9dedbac tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] [instance: be41f685-0cdd-4413-8467-43335bd91c60] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:04:15.366562 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-8a7d3477-8721-4894-a158-80edf9dedbac tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:04:15.367959 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-8a7d3477-8721-4894-a158-80edf9dedbac tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:04:15.369569 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-8a7d3477-8721-4894-a158-80edf9dedbac tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:04:15.371354 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-8a7d3477-8721-4894-a158-80edf9dedbac tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:04:15.677157 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-4620baac-edb6-4d0d-8eb5-be39a2218bc2 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5df26a2a7e854705800096f12d30c8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3309eb07e18a46a2a0bcbde1f9e46dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:04:15.698172 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-4620baac-edb6-4d0d-8eb5-be39a2218bc2 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] 10.222.0.47 "GET /compute/v2.1/servers/0ae0d266-c297-45f1-80fe-0e8f84cc22e6" status: 200 len: 1357 microversion: 2.1 time: 0.688983 Feb 19 05:04:15.700362 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 313/637] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:04:15 2021] GET /compute/v2.1/servers/0ae0d266-c297-45f1-80fe-0e8f84cc22e6 => generated 1357 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:04:15.809827 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-8a7d3477-8721-4894-a158-80edf9dedbac tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '876d82b7755b4c1f91c8ad200c0f567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b461024d8cdf4d5c966d746682381d79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:04:15.820838 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-8a7d3477-8721-4894-a158-80edf9dedbac tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] 10.222.0.47 "GET /compute/v2.1/servers/be41f685-0cdd-4413-8467-43335bd91c60" status: 200 len: 1318 microversion: 2.1 time: 0.498375 Feb 19 05:04:15.821752 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 325/638] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:04:15 2021] GET /compute/v2.1/servers/be41f685-0cdd-4413-8467-43335bd91c60 => generated 1318 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:04:16.045836 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-78eddcb5-8a7b-49bc-b69c-5e27b8e3c23d tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:04:16.047054 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-78eddcb5-8a7b-49bc-b69c-5e27b8e3c23d tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] [instance: be65ea57-bc8d-4bce-80c3-33d8b6007ed1] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:04:16.055261 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-78eddcb5-8a7b-49bc-b69c-5e27b8e3c23d tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:04:16.055820 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-78eddcb5-8a7b-49bc-b69c-5e27b8e3c23d tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:04:16.056698 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-78eddcb5-8a7b-49bc-b69c-5e27b8e3c23d tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:04:16.057186 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-78eddcb5-8a7b-49bc-b69c-5e27b8e3c23d tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:04:16.215758 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-343f646b-a88a-4199-980f-686e612ad8c6 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:04:16.216433 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-343f646b-a88a-4199-980f-686e612ad8c6 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] [instance: 74c5a115-b174-49fe-9b75-574e484a09e2] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:04:16.225463 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-343f646b-a88a-4199-980f-686e612ad8c6 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:04:16.225972 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-343f646b-a88a-4199-980f-686e612ad8c6 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:04:16.226823 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-343f646b-a88a-4199-980f-686e612ad8c6 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:04:16.227318 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-343f646b-a88a-4199-980f-686e612ad8c6 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:04:16.437489 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-78eddcb5-8a7b-49bc-b69c-5e27b8e3c23d tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3274478c0a421895f43618dc827ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50941a0cab243e9a320ff22a7648de6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:04:16.445271 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-343f646b-a88a-4199-980f-686e612ad8c6 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24af0562e2aa43ca9d601be5e16fe9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ee9a43087d5497da3af9fbf68c4572d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:04:16.455375 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-78eddcb5-8a7b-49bc-b69c-5e27b8e3c23d tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] 10.222.0.47 "GET /compute/v2.1/servers/be65ea57-bc8d-4bce-80c3-33d8b6007ed1" status: 200 len: 1675 microversion: 2.1 time: 0.413310 Feb 19 05:04:16.456549 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 314/639] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:04:16 2021] GET /compute/v2.1/servers/be65ea57-bc8d-4bce-80c3-33d8b6007ed1 => generated 1675 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:04:16.464506 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-343f646b-a88a-4199-980f-686e612ad8c6 tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] 10.222.0.47 "GET /compute/v2.1/servers/74c5a115-b174-49fe-9b75-574e484a09e2" status: 200 len: 1477 microversion: 2.1 time: 0.252414 Feb 19 05:04:16.465551 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 326/640] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:04:16 2021] GET /compute/v2.1/servers/74c5a115-b174-49fe-9b75-574e484a09e2 => generated 1477 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:04:16.733738 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-d836f3a7-0d84-4f09-9b89-0d7bbdc749c9 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:04:16.734518 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-d836f3a7-0d84-4f09-9b89-0d7bbdc749c9 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] [instance: 0ae0d266-c297-45f1-80fe-0e8f84cc22e6] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:04:16.744564 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-d836f3a7-0d84-4f09-9b89-0d7bbdc749c9 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:04:16.745073 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-d836f3a7-0d84-4f09-9b89-0d7bbdc749c9 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:04:16.746034 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-d836f3a7-0d84-4f09-9b89-0d7bbdc749c9 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:04:16.746645 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-d836f3a7-0d84-4f09-9b89-0d7bbdc749c9 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:04:16.843051 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-77cd9dff-d2aa-4d7d-90b1-854d5834ad3d tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:04:16.844489 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-77cd9dff-d2aa-4d7d-90b1-854d5834ad3d tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] [instance: be41f685-0cdd-4413-8467-43335bd91c60] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:04:16.871799 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-77cd9dff-d2aa-4d7d-90b1-854d5834ad3d tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:04:16.872314 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-77cd9dff-d2aa-4d7d-90b1-854d5834ad3d tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:04:16.873188 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-77cd9dff-d2aa-4d7d-90b1-854d5834ad3d tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:04:16.873740 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-77cd9dff-d2aa-4d7d-90b1-854d5834ad3d tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:04:17.350666 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-d836f3a7-0d84-4f09-9b89-0d7bbdc749c9 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5df26a2a7e854705800096f12d30c8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3309eb07e18a46a2a0bcbde1f9e46dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:04:17.361751 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-d836f3a7-0d84-4f09-9b89-0d7bbdc749c9 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] 10.222.0.47 "GET /compute/v2.1/servers/0ae0d266-c297-45f1-80fe-0e8f84cc22e6" status: 200 len: 1357 microversion: 2.1 time: 0.633481 Feb 19 05:04:17.362701 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 315/641] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:04:16 2021] GET /compute/v2.1/servers/0ae0d266-c297-45f1-80fe-0e8f84cc22e6 => generated 1357 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:04:17.456564 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-77cd9dff-d2aa-4d7d-90b1-854d5834ad3d tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '876d82b7755b4c1f91c8ad200c0f567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b461024d8cdf4d5c966d746682381d79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:04:17.476575 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-77cd9dff-d2aa-4d7d-90b1-854d5834ad3d tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] 10.222.0.47 "GET /compute/v2.1/servers/be41f685-0cdd-4413-8467-43335bd91c60" status: 200 len: 1318 microversion: 2.1 time: 0.638545 Feb 19 05:04:17.477128 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-eb7eb885-65eb-4a9e-a3ea-2dbb421ccdb4 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:04:17.477783 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 327/642] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:04:16 2021] GET /compute/v2.1/servers/be41f685-0cdd-4413-8467-43335bd91c60 => generated 1318 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 05:04:17.478510 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-eb7eb885-65eb-4a9e-a3ea-2dbb421ccdb4 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] [instance: be65ea57-bc8d-4bce-80c3-33d8b6007ed1] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:04:17.496868 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-eb7eb885-65eb-4a9e-a3ea-2dbb421ccdb4 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:04:17.497948 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-eb7eb885-65eb-4a9e-a3ea-2dbb421ccdb4 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:04:17.499113 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-eb7eb885-65eb-4a9e-a3ea-2dbb421ccdb4 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:04:17.500093 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-eb7eb885-65eb-4a9e-a3ea-2dbb421ccdb4 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:04:17.504532 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-c4ffe63f-a07e-41d3-ba69-54ad9f14f92d tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:04:17.505731 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-c4ffe63f-a07e-41d3-ba69-54ad9f14f92d tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] [instance: 74c5a115-b174-49fe-9b75-574e484a09e2] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:04:17.523269 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-c4ffe63f-a07e-41d3-ba69-54ad9f14f92d tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:04:17.524280 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-c4ffe63f-a07e-41d3-ba69-54ad9f14f92d tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:04:17.525956 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-c4ffe63f-a07e-41d3-ba69-54ad9f14f92d tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:04:17.526914 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-c4ffe63f-a07e-41d3-ba69-54ad9f14f92d tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:04:17.717443 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-c4ffe63f-a07e-41d3-ba69-54ad9f14f92d tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:04:17.719171 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-c4ffe63f-a07e-41d3-ba69-54ad9f14f92d tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:04:17.720141 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.objects.instance [None req-c4ffe63f-a07e-41d3-ba69-54ad9f14f92d tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lazy-loading 'fault' on Instance uuid 74c5a115-b174-49fe-9b75-574e484a09e2 {{(pid=98154) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Feb 19 05:04:17.810728 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-c4ffe63f-a07e-41d3-ba69-54ad9f14f92d tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24af0562e2aa43ca9d601be5e16fe9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ee9a43087d5497da3af9fbf68c4572d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:04:17.827880 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-c4ffe63f-a07e-41d3-ba69-54ad9f14f92d tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] 10.222.0.47 "GET /compute/v2.1/servers/74c5a115-b174-49fe-9b75-574e484a09e2" status: 200 len: 1310 microversion: 2.1 time: 0.332810 Feb 19 05:04:17.828994 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 328/643] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:04:17 2021] GET /compute/v2.1/servers/74c5a115-b174-49fe-9b75-574e484a09e2 => generated 1310 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:04:17.909846 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-eb7eb885-65eb-4a9e-a3ea-2dbb421ccdb4 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3274478c0a421895f43618dc827ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50941a0cab243e9a320ff22a7648de6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:04:17.928514 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-eb7eb885-65eb-4a9e-a3ea-2dbb421ccdb4 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] 10.222.0.47 "GET /compute/v2.1/servers/be65ea57-bc8d-4bce-80c3-33d8b6007ed1" status: 200 len: 1652 microversion: 2.1 time: 0.456423 Feb 19 05:04:17.929693 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 316/644] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:04:17 2021] GET /compute/v2.1/servers/be65ea57-bc8d-4bce-80c3-33d8b6007ed1 => generated 1652 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 05:04:17.973210 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-0a01e108-f818-4001-bafa-d260c5a72eb7 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:04:17.991809 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-0a01e108-f818-4001-bafa-d260c5a72eb7 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:04:17.992763 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-0a01e108-f818-4001-bafa-d260c5a72eb7 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:04:18.122773 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-0a01e108-f818-4001-bafa-d260c5a72eb7 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] [instance: be65ea57-bc8d-4bce-80c3-33d8b6007ed1] Going to try to start instance {{(pid=98154) start /opt/stack/nova/nova/compute/api.py:2603}} Feb 19 05:04:18.228240 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-0a01e108-f818-4001-bafa-d260c5a72eb7 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] 10.222.0.47 "POST /compute/v2.1/servers/be65ea57-bc8d-4bce-80c3-33d8b6007ed1/action" status: 202 len: 0 microversion: 2.1 time: 0.278330 Feb 19 05:04:18.229518 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 329/645] 10.222.0.47 () {60 vars in 1268 bytes} [Fri Feb 19 05:04:17 2021] POST /compute/v2.1/servers/be65ea57-bc8d-4bce-80c3-33d8b6007ed1/action => generated 0 bytes in 282 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 19 05:04:18.248356 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-95449fcd-224a-4028-b278-d1839fd6c466 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:04:18.250973 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-95449fcd-224a-4028-b278-d1839fd6c466 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] [instance: be65ea57-bc8d-4bce-80c3-33d8b6007ed1] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:04:18.267708 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-95449fcd-224a-4028-b278-d1839fd6c466 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:04:18.268494 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-95449fcd-224a-4028-b278-d1839fd6c466 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:04:18.269678 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-95449fcd-224a-4028-b278-d1839fd6c466 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:04:18.270523 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-95449fcd-224a-4028-b278-d1839fd6c466 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:04:18.382416 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-d6d70783-7364-444d-847b-c0cd186fdcfb tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:04:18.383239 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-d6d70783-7364-444d-847b-c0cd186fdcfb tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] [instance: 0ae0d266-c297-45f1-80fe-0e8f84cc22e6] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:04:18.399936 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-d6d70783-7364-444d-847b-c0cd186fdcfb tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:04:18.401220 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-d6d70783-7364-444d-847b-c0cd186fdcfb tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:04:18.402407 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-d6d70783-7364-444d-847b-c0cd186fdcfb tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:04:18.403290 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-d6d70783-7364-444d-847b-c0cd186fdcfb tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:04:18.727894 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-95449fcd-224a-4028-b278-d1839fd6c466 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3274478c0a421895f43618dc827ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50941a0cab243e9a320ff22a7648de6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:04:18.739130 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-95449fcd-224a-4028-b278-d1839fd6c466 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] 10.222.0.47 "GET /compute/v2.1/servers/be65ea57-bc8d-4bce-80c3-33d8b6007ed1" status: 200 len: 1661 microversion: 2.1 time: 0.499939 Feb 19 05:04:18.739861 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 317/646] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:04:18 2021] GET /compute/v2.1/servers/be65ea57-bc8d-4bce-80c3-33d8b6007ed1 => generated 1661 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:04:18.746349 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-a64a6ee0-999d-4576-a1e8-2aee92eca75e tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:04:18.747017 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-a64a6ee0-999d-4576-a1e8-2aee92eca75e tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] [instance: be41f685-0cdd-4413-8467-43335bd91c60] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:04:18.757145 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-a64a6ee0-999d-4576-a1e8-2aee92eca75e tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:04:18.758482 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-a64a6ee0-999d-4576-a1e8-2aee92eca75e tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:04:18.758677 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-a64a6ee0-999d-4576-a1e8-2aee92eca75e tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:04:18.759021 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-a64a6ee0-999d-4576-a1e8-2aee92eca75e tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:04:18.836056 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-d6d70783-7364-444d-847b-c0cd186fdcfb tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5df26a2a7e854705800096f12d30c8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3309eb07e18a46a2a0bcbde1f9e46dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:04:18.850628 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-d6d70783-7364-444d-847b-c0cd186fdcfb tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] 10.222.0.47 "GET /compute/v2.1/servers/0ae0d266-c297-45f1-80fe-0e8f84cc22e6" status: 200 len: 1357 microversion: 2.1 time: 0.473004 Feb 19 05:04:18.852651 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 330/647] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:04:18 2021] GET /compute/v2.1/servers/0ae0d266-c297-45f1-80fe-0e8f84cc22e6 => generated 1357 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:04:18.858253 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-2359b2d9-b13f-4c55-9fa3-a064de80f17a tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:04:18.860123 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-2359b2d9-b13f-4c55-9fa3-a064de80f17a tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] [instance: 74c5a115-b174-49fe-9b75-574e484a09e2] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:04:18.870889 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-2359b2d9-b13f-4c55-9fa3-a064de80f17a tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:04:18.871581 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-2359b2d9-b13f-4c55-9fa3-a064de80f17a tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:04:18.872688 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-2359b2d9-b13f-4c55-9fa3-a064de80f17a tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:04:18.873464 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-2359b2d9-b13f-4c55-9fa3-a064de80f17a tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:04:18.995596 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.wsgi [None req-2359b2d9-b13f-4c55-9fa3-a064de80f17a tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] HTTP exception thrown: Instance 74c5a115-b174-49fe-9b75-574e484a09e2 could not be found. Feb 19 05:04:18.997105 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-2359b2d9-b13f-4c55-9fa3-a064de80f17a tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] Returning 404 to user: Instance 74c5a115-b174-49fe-9b75-574e484a09e2 could not be found. {{(pid=98154) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 19 05:04:19.000004 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-2359b2d9-b13f-4c55-9fa3-a064de80f17a tempest-ServerRescueNegativeTestJSON-455664448 tempest-ServerRescueNegativeTestJSON-455664448-project] 10.222.0.47 "GET /compute/v2.1/servers/74c5a115-b174-49fe-9b75-574e484a09e2" status: 404 len: 111 microversion: 2.1 time: 0.144551 Feb 19 05:04:19.001483 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 331/648] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:04:18 2021] GET /compute/v2.1/servers/74c5a115-b174-49fe-9b75-574e484a09e2 => generated 111 bytes in 148 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 05:04:19.072523 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-a64a6ee0-999d-4576-a1e8-2aee92eca75e tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '876d82b7755b4c1f91c8ad200c0f567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b461024d8cdf4d5c966d746682381d79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:04:19.091057 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-a64a6ee0-999d-4576-a1e8-2aee92eca75e tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] 10.222.0.47 "GET /compute/v2.1/servers/be41f685-0cdd-4413-8467-43335bd91c60" status: 200 len: 1318 microversion: 2.1 time: 0.348154 Feb 19 05:04:19.093251 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 318/649] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:04:18 2021] GET /compute/v2.1/servers/be41f685-0cdd-4413-8467-43335bd91c60 => generated 1318 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:04:19.569762 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [req-8775cf4c-cfc3-4b5c-ad99-2ccd70f005be req-4eb08d94-d6e0-49af-9a5b-e04918592d28 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be41f685-0cdd-4413-8467-43335bd91c60", "name": "network-vif-plugged", "status": "completed", "tag": "39419b9e-6a2f-43bc-aa28-83a27266718d"}]} {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:04:19.574605 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 05:04:19.574605 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: warnings.warn(msg) Feb 19 05:04:19.627709 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [req-8775cf4c-cfc3-4b5c-ad99-2ccd70f005be req-4eb08d94-d6e0-49af-9a5b-e04918592d28 service nova] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:04:19.630369 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [req-8775cf4c-cfc3-4b5c-ad99-2ccd70f005be req-4eb08d94-d6e0-49af-9a5b-e04918592d28 service nova] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:04:19.674673 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.compute.server_external_events [req-8775cf4c-cfc3-4b5c-ad99-2ccd70f005be req-4eb08d94-d6e0-49af-9a5b-e04918592d28 service nova] Creating event network-vif-plugged:39419b9e-6a2f-43bc-aa28-83a27266718d for instance be41f685-0cdd-4413-8467-43335bd91c60 on hv-cinder-77642 Feb 19 05:04:19.692241 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [req-8775cf4c-cfc3-4b5c-ad99-2ccd70f005be req-4eb08d94-d6e0-49af-9a5b-e04918592d28 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.135551 Feb 19 05:04:19.694115 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 332/650] 10.222.0.47 () {64 vars in 1308 bytes} [Fri Feb 19 05:04:19 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 05:04:19.758441 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-413d3370-c09a-4c48-9a4c-cb885d131afb tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:04:19.759047 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-413d3370-c09a-4c48-9a4c-cb885d131afb tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] [instance: be65ea57-bc8d-4bce-80c3-33d8b6007ed1] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:04:19.768602 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-413d3370-c09a-4c48-9a4c-cb885d131afb tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:04:19.769113 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-413d3370-c09a-4c48-9a4c-cb885d131afb tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:04:19.770008 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-413d3370-c09a-4c48-9a4c-cb885d131afb tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:04:19.770508 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-413d3370-c09a-4c48-9a4c-cb885d131afb tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:04:19.871069 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-e207b6dc-2ea5-4bce-b1e0-b5a481d4ba20 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:04:19.872485 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-e207b6dc-2ea5-4bce-b1e0-b5a481d4ba20 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] [instance: 0ae0d266-c297-45f1-80fe-0e8f84cc22e6] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:04:19.883444 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-e207b6dc-2ea5-4bce-b1e0-b5a481d4ba20 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:04:19.884251 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-e207b6dc-2ea5-4bce-b1e0-b5a481d4ba20 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:04:19.885285 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-e207b6dc-2ea5-4bce-b1e0-b5a481d4ba20 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:04:19.886220 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-e207b6dc-2ea5-4bce-b1e0-b5a481d4ba20 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:04:20.475611 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-e207b6dc-2ea5-4bce-b1e0-b5a481d4ba20 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5df26a2a7e854705800096f12d30c8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3309eb07e18a46a2a0bcbde1f9e46dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:04:20.494205 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-e207b6dc-2ea5-4bce-b1e0-b5a481d4ba20 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] 10.222.0.47 "GET /compute/v2.1/servers/0ae0d266-c297-45f1-80fe-0e8f84cc22e6" status: 200 len: 1357 microversion: 2.1 time: 0.624506 Feb 19 05:04:20.506891 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 333/651] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:04:19 2021] GET /compute/v2.1/servers/0ae0d266-c297-45f1-80fe-0e8f84cc22e6 => generated 1357 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:04:20.506891 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-e1f4de17-8f99-43a9-b925-a120717d75ee tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:04:20.506891 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-e1f4de17-8f99-43a9-b925-a120717d75ee tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] [instance: be41f685-0cdd-4413-8467-43335bd91c60] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:04:20.523449 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-413d3370-c09a-4c48-9a4c-cb885d131afb tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3274478c0a421895f43618dc827ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50941a0cab243e9a320ff22a7648de6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:04:20.543201 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-e1f4de17-8f99-43a9-b925-a120717d75ee tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:04:20.544868 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-e1f4de17-8f99-43a9-b925-a120717d75ee tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:04:20.545788 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-e1f4de17-8f99-43a9-b925-a120717d75ee tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:04:20.546438 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-e1f4de17-8f99-43a9-b925-a120717d75ee tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:04:20.556111 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-413d3370-c09a-4c48-9a4c-cb885d131afb tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] 10.222.0.47 "GET /compute/v2.1/servers/be65ea57-bc8d-4bce-80c3-33d8b6007ed1" status: 200 len: 1661 microversion: 2.1 time: 0.801164 Feb 19 05:04:20.557211 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 319/652] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:04:19 2021] GET /compute/v2.1/servers/be65ea57-bc8d-4bce-80c3-33d8b6007ed1 => generated 1661 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:04:20.589611 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [req-6b53630b-bbea-4d3a-b6f4-b5898982f591 req-9d69b874-60f7-4e75-9b3b-407b0f849df9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ae0d266-c297-45f1-80fe-0e8f84cc22e6", "tag": "fa4d6bd7-26d3-4df0-ac31-ae6f1438d6f5"}]} {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:04:20.594852 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 05:04:20.594852 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: warnings.warn(msg) Feb 19 05:04:20.612837 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [req-6b53630b-bbea-4d3a-b6f4-b5898982f591 req-9d69b874-60f7-4e75-9b3b-407b0f849df9 service nova] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:04:20.613345 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [req-6b53630b-bbea-4d3a-b6f4-b5898982f591 req-9d69b874-60f7-4e75-9b3b-407b0f849df9 service nova] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:04:20.641416 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.compute.server_external_events [req-6b53630b-bbea-4d3a-b6f4-b5898982f591 req-9d69b874-60f7-4e75-9b3b-407b0f849df9 service nova] Creating event network-changed:fa4d6bd7-26d3-4df0-ac31-ae6f1438d6f5 for instance 0ae0d266-c297-45f1-80fe-0e8f84cc22e6 on hv-cinder-77642 Feb 19 05:04:20.657352 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [req-6b53630b-bbea-4d3a-b6f4-b5898982f591 req-9d69b874-60f7-4e75-9b3b-407b0f849df9 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084203 Feb 19 05:04:20.658349 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 320/653] 10.222.0.47 () {64 vars in 1308 bytes} [Fri Feb 19 05:04:20 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 05:04:21.317633 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-e1f4de17-8f99-43a9-b925-a120717d75ee tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '876d82b7755b4c1f91c8ad200c0f567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b461024d8cdf4d5c966d746682381d79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:04:21.330028 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-e1f4de17-8f99-43a9-b925-a120717d75ee tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] 10.222.0.47 "GET /compute/v2.1/servers/be41f685-0cdd-4413-8467-43335bd91c60" status: 200 len: 1318 microversion: 2.1 time: 0.828500 Feb 19 05:04:21.330920 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 334/654] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:04:20 2021] GET /compute/v2.1/servers/be41f685-0cdd-4413-8467-43335bd91c60 => generated 1318 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:04:21.516572 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-b6a75287-7ca8-4d3e-aadc-515791c77970 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:04:21.517567 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-b6a75287-7ca8-4d3e-aadc-515791c77970 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] [instance: 0ae0d266-c297-45f1-80fe-0e8f84cc22e6] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:04:21.527468 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-b6a75287-7ca8-4d3e-aadc-515791c77970 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:04:21.528701 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-b6a75287-7ca8-4d3e-aadc-515791c77970 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:04:21.529793 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-b6a75287-7ca8-4d3e-aadc-515791c77970 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:04:21.531022 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-b6a75287-7ca8-4d3e-aadc-515791c77970 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:04:21.591116 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-a588fba8-cf62-491f-9616-f6a2216f45a8 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:04:21.592103 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-a588fba8-cf62-491f-9616-f6a2216f45a8 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] [instance: be65ea57-bc8d-4bce-80c3-33d8b6007ed1] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:04:21.606430 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-a588fba8-cf62-491f-9616-f6a2216f45a8 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:04:21.611521 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-a588fba8-cf62-491f-9616-f6a2216f45a8 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:04:21.615970 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-a588fba8-cf62-491f-9616-f6a2216f45a8 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:04:21.616934 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-a588fba8-cf62-491f-9616-f6a2216f45a8 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:04:22.167811 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-b6a75287-7ca8-4d3e-aadc-515791c77970 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5df26a2a7e854705800096f12d30c8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3309eb07e18a46a2a0bcbde1f9e46dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:04:22.203251 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-b6a75287-7ca8-4d3e-aadc-515791c77970 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] 10.222.0.47 "GET /compute/v2.1/servers/0ae0d266-c297-45f1-80fe-0e8f84cc22e6" status: 200 len: 1357 microversion: 2.1 time: 0.688487 Feb 19 05:04:22.224568 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 321/655] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:04:21 2021] GET /compute/v2.1/servers/0ae0d266-c297-45f1-80fe-0e8f84cc22e6 => generated 1357 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:04:22.355040 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-e6964c70-a3a0-4d7b-8a6a-89a9375abbf0 tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:04:22.361572 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-e6964c70-a3a0-4d7b-8a6a-89a9375abbf0 tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] [instance: be41f685-0cdd-4413-8467-43335bd91c60] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:04:22.392198 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-e6964c70-a3a0-4d7b-8a6a-89a9375abbf0 tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:04:22.392725 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-e6964c70-a3a0-4d7b-8a6a-89a9375abbf0 tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:04:22.393667 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-e6964c70-a3a0-4d7b-8a6a-89a9375abbf0 tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:04:22.394155 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-e6964c70-a3a0-4d7b-8a6a-89a9375abbf0 tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:04:23.233269 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-e6964c70-a3a0-4d7b-8a6a-89a9375abbf0 tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '876d82b7755b4c1f91c8ad200c0f567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b461024d8cdf4d5c966d746682381d79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:04:23.244471 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-e6964c70-a3a0-4d7b-8a6a-89a9375abbf0 tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] 10.222.0.47 "GET /compute/v2.1/servers/be41f685-0cdd-4413-8467-43335bd91c60" status: 200 len: 1507 microversion: 2.1 time: 0.897043 Feb 19 05:04:23.245658 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 322/656] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:04:22 2021] GET /compute/v2.1/servers/be41f685-0cdd-4413-8467-43335bd91c60 => generated 1507 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 05:04:23.262320 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-15e5614a-a999-425f-b4a9-3bde0887c5ee tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:04:23.266229 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-15e5614a-a999-425f-b4a9-3bde0887c5ee tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] [instance: 0ae0d266-c297-45f1-80fe-0e8f84cc22e6] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:04:23.285120 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-15e5614a-a999-425f-b4a9-3bde0887c5ee tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:04:23.286223 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-15e5614a-a999-425f-b4a9-3bde0887c5ee tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:04:23.288267 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-15e5614a-a999-425f-b4a9-3bde0887c5ee tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:04:23.289859 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-15e5614a-a999-425f-b4a9-3bde0887c5ee tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:04:23.293344 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-a588fba8-cf62-491f-9616-f6a2216f45a8 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3274478c0a421895f43618dc827ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50941a0cab243e9a320ff22a7648de6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:04:23.307221 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-a588fba8-cf62-491f-9616-f6a2216f45a8 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] 10.222.0.47 "GET /compute/v2.1/servers/be65ea57-bc8d-4bce-80c3-33d8b6007ed1" status: 200 len: 1661 microversion: 2.1 time: 1.720626 Feb 19 05:04:23.307902 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 335/657] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:04:21 2021] GET /compute/v2.1/servers/be65ea57-bc8d-4bce-80c3-33d8b6007ed1 => generated 1661 bytes in 1722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:04:23.325232 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-a854320a-6d4c-4351-a269-b20047cf15fa tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "488cb9d0-0b5a-49b4-9680-c7aaffde9cf0", "device": "/dev/sdb"}} {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:04:23.328386 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-a854320a-6d4c-4351-a269-b20047cf15fa tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] [instance: be41f685-0cdd-4413-8467-43335bd91c60] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:04:23.350683 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-a854320a-6d4c-4351-a269-b20047cf15fa tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:04:23.352111 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-a854320a-6d4c-4351-a269-b20047cf15fa tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:04:23.354020 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-a854320a-6d4c-4351-a269-b20047cf15fa tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:04:23.355262 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-a854320a-6d4c-4351-a269-b20047cf15fa tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:04:23.856332 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-15e5614a-a999-425f-b4a9-3bde0887c5ee tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5df26a2a7e854705800096f12d30c8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3309eb07e18a46a2a0bcbde1f9e46dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:04:23.876240 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-15e5614a-a999-425f-b4a9-3bde0887c5ee tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] 10.222.0.47 "GET /compute/v2.1/servers/0ae0d266-c297-45f1-80fe-0e8f84cc22e6" status: 200 len: 1357 microversion: 2.1 time: 0.627236 Feb 19 05:04:23.877191 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 323/658] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:04:23 2021] GET /compute/v2.1/servers/0ae0d266-c297-45f1-80fe-0e8f84cc22e6 => generated 1357 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:04:24.064511 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-a854320a-6d4c-4351-a269-b20047cf15fa tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] 10.222.0.47 "POST /compute/v2.1/servers/be41f685-0cdd-4413-8467-43335bd91c60/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.742357 Feb 19 05:04:24.065827 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 336/659] 10.222.0.47 () {60 vars in 1313 bytes} [Fri Feb 19 05:04:23 2021] POST /compute/v2.1/servers/be41f685-0cdd-4413-8467-43335bd91c60/os-volume_attachments => generated 194 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 05:04:24.327840 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-6e23b683-33ef-4db4-b01f-d6622b1ab178 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:04:24.328538 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-6e23b683-33ef-4db4-b01f-d6622b1ab178 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] [instance: be65ea57-bc8d-4bce-80c3-33d8b6007ed1] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:04:24.342032 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-6e23b683-33ef-4db4-b01f-d6622b1ab178 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:04:24.342552 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-6e23b683-33ef-4db4-b01f-d6622b1ab178 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:04:24.343514 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-6e23b683-33ef-4db4-b01f-d6622b1ab178 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:04:24.344238 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-6e23b683-33ef-4db4-b01f-d6622b1ab178 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:04:24.901651 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-9b8f1f95-1cd5-4b84-bbd8-32fb52d8283a tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:04:24.908280 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-9b8f1f95-1cd5-4b84-bbd8-32fb52d8283a tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] [instance: 0ae0d266-c297-45f1-80fe-0e8f84cc22e6] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:04:24.969207 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-9b8f1f95-1cd5-4b84-bbd8-32fb52d8283a tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:04:24.970576 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-9b8f1f95-1cd5-4b84-bbd8-32fb52d8283a tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:04:24.972883 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-9b8f1f95-1cd5-4b84-bbd8-32fb52d8283a tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:04:24.974120 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-9b8f1f95-1cd5-4b84-bbd8-32fb52d8283a tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:04:25.250398 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-6e23b683-33ef-4db4-b01f-d6622b1ab178 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3274478c0a421895f43618dc827ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50941a0cab243e9a320ff22a7648de6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:04:25.290372 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-6e23b683-33ef-4db4-b01f-d6622b1ab178 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] 10.222.0.47 "GET /compute/v2.1/servers/be65ea57-bc8d-4bce-80c3-33d8b6007ed1" status: 200 len: 1665 microversion: 2.1 time: 0.966800 Feb 19 05:04:25.297693 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 324/660] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:04:24 2021] GET /compute/v2.1/servers/be65ea57-bc8d-4bce-80c3-33d8b6007ed1 => generated 1665 bytes in 975 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:04:25.683705 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-9b8f1f95-1cd5-4b84-bbd8-32fb52d8283a tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5df26a2a7e854705800096f12d30c8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3309eb07e18a46a2a0bcbde1f9e46dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:04:25.697495 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-9b8f1f95-1cd5-4b84-bbd8-32fb52d8283a tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] 10.222.0.47 "GET /compute/v2.1/servers/0ae0d266-c297-45f1-80fe-0e8f84cc22e6" status: 200 len: 1357 microversion: 2.1 time: 0.804871 Feb 19 05:04:25.712525 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 337/661] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:04:24 2021] GET /compute/v2.1/servers/0ae0d266-c297-45f1-80fe-0e8f84cc22e6 => generated 1357 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 05:04:26.720735 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-59ad62fb-7589-4c64-a177-1c1789067d28 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:04:26.721414 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-59ad62fb-7589-4c64-a177-1c1789067d28 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] [instance: 0ae0d266-c297-45f1-80fe-0e8f84cc22e6] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:04:26.730079 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-59ad62fb-7589-4c64-a177-1c1789067d28 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:04:26.730588 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-59ad62fb-7589-4c64-a177-1c1789067d28 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:04:26.731503 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-59ad62fb-7589-4c64-a177-1c1789067d28 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:04:26.731950 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-59ad62fb-7589-4c64-a177-1c1789067d28 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:04:27.057593 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-59ad62fb-7589-4c64-a177-1c1789067d28 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5df26a2a7e854705800096f12d30c8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3309eb07e18a46a2a0bcbde1f9e46dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:04:27.071911 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-59ad62fb-7589-4c64-a177-1c1789067d28 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] 10.222.0.47 "GET /compute/v2.1/servers/0ae0d266-c297-45f1-80fe-0e8f84cc22e6" status: 200 len: 1357 microversion: 2.1 time: 0.355500 Feb 19 05:04:27.073040 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 325/662] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:04:26 2021] GET /compute/v2.1/servers/0ae0d266-c297-45f1-80fe-0e8f84cc22e6 => generated 1357 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:04:27.457573 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [req-70721f4d-71ff-4c37-bcb2-bc7aabf9d3c9 req-71c5e0dd-c2fa-4cf6-9b8b-0e968839436c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ae0d266-c297-45f1-80fe-0e8f84cc22e6", "name": "network-vif-plugged", "status": "completed", "tag": "fa4d6bd7-26d3-4df0-ac31-ae6f1438d6f5"}]} {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:04:27.460108 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 05:04:27.460108 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: warnings.warn(msg) Feb 19 05:04:27.476230 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [req-70721f4d-71ff-4c37-bcb2-bc7aabf9d3c9 req-71c5e0dd-c2fa-4cf6-9b8b-0e968839436c service nova] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:04:27.476968 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [req-70721f4d-71ff-4c37-bcb2-bc7aabf9d3c9 req-71c5e0dd-c2fa-4cf6-9b8b-0e968839436c service nova] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:04:27.502103 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.compute.server_external_events [req-70721f4d-71ff-4c37-bcb2-bc7aabf9d3c9 req-71c5e0dd-c2fa-4cf6-9b8b-0e968839436c service nova] Creating event network-vif-plugged:fa4d6bd7-26d3-4df0-ac31-ae6f1438d6f5 for instance 0ae0d266-c297-45f1-80fe-0e8f84cc22e6 on hv-cinder-77642 Feb 19 05:04:27.509513 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [req-70721f4d-71ff-4c37-bcb2-bc7aabf9d3c9 req-71c5e0dd-c2fa-4cf6-9b8b-0e968839436c service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058733 Feb 19 05:04:27.511216 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 338/663] 10.222.0.47 () {64 vars in 1308 bytes} [Fri Feb 19 05:04:27 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 05:04:28.099480 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-54024d28-baa6-4aef-9be9-c491705b6b1e tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:04:28.100777 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-54024d28-baa6-4aef-9be9-c491705b6b1e tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] [instance: 0ae0d266-c297-45f1-80fe-0e8f84cc22e6] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:04:28.109465 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-54024d28-baa6-4aef-9be9-c491705b6b1e tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:04:28.109955 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-54024d28-baa6-4aef-9be9-c491705b6b1e tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:04:28.111066 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-54024d28-baa6-4aef-9be9-c491705b6b1e tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:04:28.111616 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-54024d28-baa6-4aef-9be9-c491705b6b1e tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:04:28.610562 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-5b35009f-1bf1-4f60-bf69-e0eebbe10870 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:04:28.611744 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-5b35009f-1bf1-4f60-bf69-e0eebbe10870 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] [instance: 798b77ff-c3ca-4c65-a120-db12ad953621] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:04:28.625834 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-5b35009f-1bf1-4f60-bf69-e0eebbe10870 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:04:28.626636 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-5b35009f-1bf1-4f60-bf69-e0eebbe10870 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:04:28.628047 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-5b35009f-1bf1-4f60-bf69-e0eebbe10870 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:04:28.628834 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-5b35009f-1bf1-4f60-bf69-e0eebbe10870 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:04:28.759915 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-5b35009f-1bf1-4f60-bf69-e0eebbe10870 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] 10.222.0.47 "GET /compute/v2.1/servers/798b77ff-c3ca-4c65-a120-db12ad953621/os-volume_attachments/cf5e3a67-8d86-4218-a407-efea023bc118" status: 200 len: 194 microversion: 2.20 time: 0.155095 Feb 19 05:04:28.761529 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 339/664] 10.222.0.47 () {60 vars in 1444 bytes} [Fri Feb 19 05:04:28 2021] GET /compute/v2.1/servers/798b77ff-c3ca-4c65-a120-db12ad953621/os-volume_attachments/cf5e3a67-8d86-4218-a407-efea023bc118 => generated 194 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 19 05:04:28.785456 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-54024d28-baa6-4aef-9be9-c491705b6b1e tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5df26a2a7e854705800096f12d30c8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3309eb07e18a46a2a0bcbde1f9e46dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:04:28.853939 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-54024d28-baa6-4aef-9be9-c491705b6b1e tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] 10.222.0.47 "GET /compute/v2.1/servers/0ae0d266-c297-45f1-80fe-0e8f84cc22e6" status: 200 len: 1357 microversion: 2.1 time: 0.757987 Feb 19 05:04:28.855245 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 326/665] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:04:28 2021] GET /compute/v2.1/servers/0ae0d266-c297-45f1-80fe-0e8f84cc22e6 => generated 1357 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:04:29.029807 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-b60817c8-2760-4680-baa6-e0f7d040cc62 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:04:29.031194 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-b60817c8-2760-4680-baa6-e0f7d040cc62 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] [instance: 798b77ff-c3ca-4c65-a120-db12ad953621] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:04:29.049445 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-b60817c8-2760-4680-baa6-e0f7d040cc62 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:04:29.050393 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-b60817c8-2760-4680-baa6-e0f7d040cc62 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:04:29.052640 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-b60817c8-2760-4680-baa6-e0f7d040cc62 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:04:29.053801 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-b60817c8-2760-4680-baa6-e0f7d040cc62 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:04:29.416826 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.objects.instance [None req-b60817c8-2760-4680-baa6-e0f7d040cc62 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lazy-loading 'services' on Instance uuid 798b77ff-c3ca-4c65-a120-db12ad953621 {{(pid=98154) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Feb 19 05:04:29.657033 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-b60817c8-2760-4680-baa6-e0f7d040cc62 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] 10.222.0.47 "DELETE /compute/v2.1/servers/798b77ff-c3ca-4c65-a120-db12ad953621/os-volume_attachments/cf5e3a67-8d86-4218-a407-efea023bc118" status: 202 len: 0 microversion: 2.20 time: 0.635002 Feb 19 05:04:29.658028 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 340/666] 10.222.0.47 () {60 vars in 1447 bytes} [Fri Feb 19 05:04:29 2021] DELETE /compute/v2.1/servers/798b77ff-c3ca-4c65-a120-db12ad953621/os-volume_attachments/cf5e3a67-8d86-4218-a407-efea023bc118 => generated 0 bytes in 639 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Feb 19 05:04:29.892982 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-42c7079b-166d-47d6-ac40-815e70a71670 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:04:29.893717 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-42c7079b-166d-47d6-ac40-815e70a71670 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] [instance: 0ae0d266-c297-45f1-80fe-0e8f84cc22e6] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:04:29.903274 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-42c7079b-166d-47d6-ac40-815e70a71670 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:04:29.903846 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-42c7079b-166d-47d6-ac40-815e70a71670 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:04:29.904718 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-42c7079b-166d-47d6-ac40-815e70a71670 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:04:29.905924 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-42c7079b-166d-47d6-ac40-815e70a71670 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:04:30.323728 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-42c7079b-166d-47d6-ac40-815e70a71670 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5df26a2a7e854705800096f12d30c8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3309eb07e18a46a2a0bcbde1f9e46dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:04:30.335440 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-42c7079b-166d-47d6-ac40-815e70a71670 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] 10.222.0.47 "GET /compute/v2.1/servers/0ae0d266-c297-45f1-80fe-0e8f84cc22e6" status: 200 len: 1547 microversion: 2.1 time: 0.451156 Feb 19 05:04:30.336330 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 327/667] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:04:29 2021] GET /compute/v2.1/servers/0ae0d266-c297-45f1-80fe-0e8f84cc22e6 => generated 1547 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 05:04:30.356814 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-e355cbb6-2362-442a-9e1a-e7463525a1d2 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:04:30.357916 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-e355cbb6-2362-442a-9e1a-e7463525a1d2 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] [instance: 0ae0d266-c297-45f1-80fe-0e8f84cc22e6] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:04:30.369792 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-e355cbb6-2362-442a-9e1a-e7463525a1d2 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:04:30.370516 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-e355cbb6-2362-442a-9e1a-e7463525a1d2 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:04:30.371660 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-e355cbb6-2362-442a-9e1a-e7463525a1d2 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:04:30.372268 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-e355cbb6-2362-442a-9e1a-e7463525a1d2 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:04:30.629161 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-e355cbb6-2362-442a-9e1a-e7463525a1d2 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5df26a2a7e854705800096f12d30c8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3309eb07e18a46a2a0bcbde1f9e46dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:04:30.638998 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-e355cbb6-2362-442a-9e1a-e7463525a1d2 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] 10.222.0.47 "GET /compute/v2.1/servers/0ae0d266-c297-45f1-80fe-0e8f84cc22e6" status: 200 len: 1547 microversion: 2.1 time: 0.288327 Feb 19 05:04:30.639756 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 341/668] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:04:30 2021] GET /compute/v2.1/servers/0ae0d266-c297-45f1-80fe-0e8f84cc22e6 => generated 1547 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:04:30.656963 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-f1900a4a-9067-4994-b69b-7d7b107777ca tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:04:30.660901 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 05:04:30.660901 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: warnings.warn(msg) Feb 19 05:04:30.662049 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-f1900a4a-9067-4994-b69b-7d7b107777ca tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5df26a2a7e854705800096f12d30c8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3309eb07e18a46a2a0bcbde1f9e46dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:04:30.662903 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-f1900a4a-9067-4994-b69b-7d7b107777ca tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Searching by: {'deleted': False, 'project_id': '3309eb07e18a46a2a0bcbde1f9e46dd8'} {{(pid=98153) get_all /opt/stack/nova/nova/compute/api.py:2833}} Feb 19 05:04:30.669039 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-f1900a4a-9067-4994-b69b-7d7b107777ca tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:04:30.669540 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-f1900a4a-9067-4994-b69b-7d7b107777ca tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:04:30.670413 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-f1900a4a-9067-4994-b69b-7d7b107777ca tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:04:30.671516 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-f1900a4a-9067-4994-b69b-7d7b107777ca tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:04:30.793946 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.multi_cell_list [None req-f1900a4a-9067-4994-b69b-7d7b107777ca tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=98153) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:376}} Feb 19 05:04:30.899389 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-f1900a4a-9067-4994-b69b-7d7b107777ca tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] 10.222.0.47 "GET /compute/v2.1/servers" status: 200 len: 341 microversion: 2.1 time: 0.246876 Feb 19 05:04:30.901290 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 328/669] 10.222.0.47 () {58 vars in 1115 bytes} [Fri Feb 19 05:04:30 2021] GET /compute/v2.1/servers => generated 341 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 05:04:30.912289 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-e73cd00b-ff1c-4f8e-9658-b1a0fc2009b6 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:04:30.912954 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-e73cd00b-ff1c-4f8e-9658-b1a0fc2009b6 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] [instance: 0ae0d266-c297-45f1-80fe-0e8f84cc22e6] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:04:30.922685 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-e73cd00b-ff1c-4f8e-9658-b1a0fc2009b6 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:04:30.923399 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-e73cd00b-ff1c-4f8e-9658-b1a0fc2009b6 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:04:30.924615 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-e73cd00b-ff1c-4f8e-9658-b1a0fc2009b6 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:04:30.925773 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-e73cd00b-ff1c-4f8e-9658-b1a0fc2009b6 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:04:31.203991 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-e73cd00b-ff1c-4f8e-9658-b1a0fc2009b6 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5df26a2a7e854705800096f12d30c8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3309eb07e18a46a2a0bcbde1f9e46dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:04:31.214517 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-e73cd00b-ff1c-4f8e-9658-b1a0fc2009b6 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] 10.222.0.47 "GET /compute/v2.1/servers/0ae0d266-c297-45f1-80fe-0e8f84cc22e6" status: 200 len: 1547 microversion: 2.1 time: 0.306709 Feb 19 05:04:31.215179 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 342/670] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:04:30 2021] GET /compute/v2.1/servers/0ae0d266-c297-45f1-80fe-0e8f84cc22e6 => generated 1547 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:04:33.965561 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-013555f5-3244-409b-bc12-8650e1df6239 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "20c7685c-bba3-4282-b9ae-ee918056d0c5"}} {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:04:33.966940 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-013555f5-3244-409b-bc12-8650e1df6239 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] [instance: 0ae0d266-c297-45f1-80fe-0e8f84cc22e6] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:04:33.976006 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-013555f5-3244-409b-bc12-8650e1df6239 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:04:33.976540 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-013555f5-3244-409b-bc12-8650e1df6239 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:04:33.977403 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-013555f5-3244-409b-bc12-8650e1df6239 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:04:33.977904 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-013555f5-3244-409b-bc12-8650e1df6239 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:04:35.699314 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-013555f5-3244-409b-bc12-8650e1df6239 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] 10.222.0.47 "POST /compute/v2.1/servers/0ae0d266-c297-45f1-80fe-0e8f84cc22e6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.738229 Feb 19 05:04:35.700244 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 329/671] 10.222.0.47 () {60 vars in 1313 bytes} [Fri Feb 19 05:04:33 2021] POST /compute/v2.1/servers/0ae0d266-c297-45f1-80fe-0e8f84cc22e6/os-volume_attachments => generated 194 bytes in 1740 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 05:04:36.908294 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-060d2079-3611-41cf-854e-cb39802c11ac tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:04:36.909341 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-060d2079-3611-41cf-854e-cb39802c11ac tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] [instance: 798b77ff-c3ca-4c65-a120-db12ad953621] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:04:36.919775 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-060d2079-3611-41cf-854e-cb39802c11ac tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:04:36.920445 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-060d2079-3611-41cf-854e-cb39802c11ac tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:04:36.921501 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-060d2079-3611-41cf-854e-cb39802c11ac tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:04:36.922257 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-060d2079-3611-41cf-854e-cb39802c11ac tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:04:37.007922 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-060d2079-3611-41cf-854e-cb39802c11ac tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] [instance: 798b77ff-c3ca-4c65-a120-db12ad953621] Going to try to terminate instance {{(pid=98154) delete /opt/stack/nova/nova/compute/api.py:2540}} Feb 19 05:04:37.141555 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-060d2079-3611-41cf-854e-cb39802c11ac tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] 10.222.0.47 "DELETE /compute/v2.1/servers/798b77ff-c3ca-4c65-a120-db12ad953621" status: 204 len: 0 microversion: 2.20 time: 0.237765 Feb 19 05:04:37.142195 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 343/672] 10.222.0.47 () {60 vars in 1270 bytes} [Fri Feb 19 05:04:36 2021] DELETE /compute/v2.1/servers/798b77ff-c3ca-4c65-a120-db12ad953621 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Feb 19 05:04:37.152111 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-25bd4453-2c12-4b7e-a753-d0fc970191ba tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:04:37.153003 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-25bd4453-2c12-4b7e-a753-d0fc970191ba tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] [instance: 798b77ff-c3ca-4c65-a120-db12ad953621] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:04:37.163302 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-25bd4453-2c12-4b7e-a753-d0fc970191ba tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:04:37.163956 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-25bd4453-2c12-4b7e-a753-d0fc970191ba tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:04:37.164920 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-25bd4453-2c12-4b7e-a753-d0fc970191ba tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:04:37.165502 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-25bd4453-2c12-4b7e-a753-d0fc970191ba tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:04:37.400981 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-25bd4453-2c12-4b7e-a753-d0fc970191ba tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:04:37.412200 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-25bd4453-2c12-4b7e-a753-d0fc970191ba tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:04:37.413772 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-25bd4453-2c12-4b7e-a753-d0fc970191ba tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:04:37.415034 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-25bd4453-2c12-4b7e-a753-d0fc970191ba tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] 10.222.0.47 "GET /compute/v2.1/servers/798b77ff-c3ca-4c65-a120-db12ad953621" status: 200 len: 1803 microversion: 2.20 time: 0.267671 Feb 19 05:04:37.415715 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 330/673] 10.222.0.47 () {60 vars in 1267 bytes} [Fri Feb 19 05:04:37 2021] GET /compute/v2.1/servers/798b77ff-c3ca-4c65-a120-db12ad953621 => generated 1803 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 05:04:38.663989 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-52c430f0-316b-496d-97f4-e2eea5ebaae8 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:04:38.664779 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-52c430f0-316b-496d-97f4-e2eea5ebaae8 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] [instance: 798b77ff-c3ca-4c65-a120-db12ad953621] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:04:38.673884 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-52c430f0-316b-496d-97f4-e2eea5ebaae8 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:04:38.674394 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-52c430f0-316b-496d-97f4-e2eea5ebaae8 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:04:38.675271 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-52c430f0-316b-496d-97f4-e2eea5ebaae8 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:04:38.675848 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-52c430f0-316b-496d-97f4-e2eea5ebaae8 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:04:38.906982 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-52c430f0-316b-496d-97f4-e2eea5ebaae8 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:04:38.917579 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-52c430f0-316b-496d-97f4-e2eea5ebaae8 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:04:38.919165 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-52c430f0-316b-496d-97f4-e2eea5ebaae8 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:04:38.920468 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-52c430f0-316b-496d-97f4-e2eea5ebaae8 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] 10.222.0.47 "GET /compute/v2.1/servers/798b77ff-c3ca-4c65-a120-db12ad953621" status: 200 len: 1803 microversion: 2.20 time: 0.488397 Feb 19 05:04:38.921872 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 344/674] 10.222.0.47 () {60 vars in 1267 bytes} [Fri Feb 19 05:04:38 2021] GET /compute/v2.1/servers/798b77ff-c3ca-4c65-a120-db12ad953621 => generated 1803 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 05:04:39.948197 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-09283cf4-6f5f-4c72-9d48-1aa474e49072 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:04:39.950612 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-09283cf4-6f5f-4c72-9d48-1aa474e49072 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] [instance: 798b77ff-c3ca-4c65-a120-db12ad953621] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:04:39.969074 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-09283cf4-6f5f-4c72-9d48-1aa474e49072 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:04:39.970310 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-09283cf4-6f5f-4c72-9d48-1aa474e49072 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:04:39.972143 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-09283cf4-6f5f-4c72-9d48-1aa474e49072 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:04:39.973317 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-09283cf4-6f5f-4c72-9d48-1aa474e49072 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:04:40.248259 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-09283cf4-6f5f-4c72-9d48-1aa474e49072 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:04:40.259366 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-09283cf4-6f5f-4c72-9d48-1aa474e49072 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:04:40.261294 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-09283cf4-6f5f-4c72-9d48-1aa474e49072 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:04:40.262629 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-09283cf4-6f5f-4c72-9d48-1aa474e49072 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] 10.222.0.47 "GET /compute/v2.1/servers/798b77ff-c3ca-4c65-a120-db12ad953621" status: 200 len: 1725 microversion: 2.20 time: 0.322070 Feb 19 05:04:40.265612 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 331/675] 10.222.0.47 () {60 vars in 1267 bytes} [Fri Feb 19 05:04:39 2021] GET /compute/v2.1/servers/798b77ff-c3ca-4c65-a120-db12ad953621 => generated 1725 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 05:04:40.567979 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-ae8f6fca-3532-41c1-9a2b-6b5c1a68269d tempest-VolumesTestJSON-1774807201 tempest-VolumesTestJSON-1774807201-project] Calling method '.version_select at 0x7f27085cbae8>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:04:40.677160 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-ae8f6fca-3532-41c1-9a2b-6b5c1a68269d tempest-VolumesTestJSON-1774807201 tempest-VolumesTestJSON-1774807201-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/fe92a3bf-5c38-4e40-a8f0-3833ec69ee3c" status: 200 len: 351 microversion: 2.1 time: 0.113063 Feb 19 05:04:40.677805 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 345/676] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Feb 19 05:04:40 2021] GET /compute/v2.1/os-volumes/fe92a3bf-5c38-4e40-a8f0-3833ec69ee3c => generated 351 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 05:04:41.284017 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-6e020d73-1ccb-41f2-967e-6f9492d535f0 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:04:41.284693 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-6e020d73-1ccb-41f2-967e-6f9492d535f0 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] [instance: 798b77ff-c3ca-4c65-a120-db12ad953621] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:04:41.293588 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-6e020d73-1ccb-41f2-967e-6f9492d535f0 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:04:41.294100 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-6e020d73-1ccb-41f2-967e-6f9492d535f0 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:04:41.294951 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-6e020d73-1ccb-41f2-967e-6f9492d535f0 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:04:41.295691 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-6e020d73-1ccb-41f2-967e-6f9492d535f0 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:04:41.532954 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-6e020d73-1ccb-41f2-967e-6f9492d535f0 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:04:41.542853 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-6e020d73-1ccb-41f2-967e-6f9492d535f0 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:04:41.544427 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-6e020d73-1ccb-41f2-967e-6f9492d535f0 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:04:41.546396 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-6e020d73-1ccb-41f2-967e-6f9492d535f0 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] 10.222.0.47 "GET /compute/v2.1/servers/798b77ff-c3ca-4c65-a120-db12ad953621" status: 200 len: 1725 microversion: 2.20 time: 0.266310 Feb 19 05:04:41.547227 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 332/677] 10.222.0.47 () {60 vars in 1267 bytes} [Fri Feb 19 05:04:41 2021] GET /compute/v2.1/servers/798b77ff-c3ca-4c65-a120-db12ad953621 => generated 1725 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 05:04:42.568308 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-0d4ff965-f72f-4e94-aa93-03ee517c6ea9 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:04:42.568865 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-0d4ff965-f72f-4e94-aa93-03ee517c6ea9 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] [instance: 798b77ff-c3ca-4c65-a120-db12ad953621] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:04:42.580061 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-0d4ff965-f72f-4e94-aa93-03ee517c6ea9 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:04:42.581022 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-0d4ff965-f72f-4e94-aa93-03ee517c6ea9 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:04:42.582688 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-0d4ff965-f72f-4e94-aa93-03ee517c6ea9 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:04:42.583648 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-0d4ff965-f72f-4e94-aa93-03ee517c6ea9 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:04:42.838388 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-0d4ff965-f72f-4e94-aa93-03ee517c6ea9 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:04:42.850594 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-0d4ff965-f72f-4e94-aa93-03ee517c6ea9 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:04:42.852217 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-0d4ff965-f72f-4e94-aa93-03ee517c6ea9 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:04:42.853466 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-0d4ff965-f72f-4e94-aa93-03ee517c6ea9 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] 10.222.0.47 "GET /compute/v2.1/servers/798b77ff-c3ca-4c65-a120-db12ad953621" status: 200 len: 1725 microversion: 2.20 time: 0.289374 Feb 19 05:04:42.854086 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 346/678] 10.222.0.47 () {60 vars in 1267 bytes} [Fri Feb 19 05:04:42 2021] GET /compute/v2.1/servers/798b77ff-c3ca-4c65-a120-db12ad953621 => generated 1725 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 05:04:43.873736 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-2ddbfd2c-9f4c-4732-a5b9-e7a5f88e6ab5 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:04:43.875074 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-2ddbfd2c-9f4c-4732-a5b9-e7a5f88e6ab5 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] [instance: 798b77ff-c3ca-4c65-a120-db12ad953621] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:04:43.885232 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-2ddbfd2c-9f4c-4732-a5b9-e7a5f88e6ab5 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:04:43.886138 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-2ddbfd2c-9f4c-4732-a5b9-e7a5f88e6ab5 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:04:43.887393 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-2ddbfd2c-9f4c-4732-a5b9-e7a5f88e6ab5 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:04:43.888017 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-2ddbfd2c-9f4c-4732-a5b9-e7a5f88e6ab5 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:04:44.341626 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-2ddbfd2c-9f4c-4732-a5b9-e7a5f88e6ab5 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:04:44.354664 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-2ddbfd2c-9f4c-4732-a5b9-e7a5f88e6ab5 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:04:44.357435 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-2ddbfd2c-9f4c-4732-a5b9-e7a5f88e6ab5 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:04:44.360130 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-2ddbfd2c-9f4c-4732-a5b9-e7a5f88e6ab5 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] 10.222.0.47 "GET /compute/v2.1/servers/798b77ff-c3ca-4c65-a120-db12ad953621" status: 200 len: 1725 microversion: 2.20 time: 0.490709 Feb 19 05:04:44.371670 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 333/679] 10.222.0.47 () {60 vars in 1267 bytes} [Fri Feb 19 05:04:43 2021] GET /compute/v2.1/servers/798b77ff-c3ca-4c65-a120-db12ad953621 => generated 1725 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 05:04:44.569402 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-9cef5cec-d504-42f2-8d94-8c068eaf68e0 tempest-VolumesTestJSON-1774807201 tempest-VolumesTestJSON-1774807201-project] Calling method '.version_select at 0x7f270bacf268>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:04:44.685693 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-9cef5cec-d504-42f2-8d94-8c068eaf68e0 tempest-VolumesTestJSON-1774807201 tempest-VolumesTestJSON-1774807201-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/5b77a86b-864f-4f5d-8109-9f8bc3e16383" status: 200 len: 351 microversion: 2.1 time: 0.120342 Feb 19 05:04:44.687001 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 347/680] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Feb 19 05:04:44 2021] GET /compute/v2.1/os-volumes/5b77a86b-864f-4f5d-8109-9f8bc3e16383 => generated 351 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 05:04:45.391422 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-7127b57a-a719-458f-93ef-f837a5dd102b tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:04:45.392207 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-7127b57a-a719-458f-93ef-f837a5dd102b tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] [instance: 798b77ff-c3ca-4c65-a120-db12ad953621] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:04:45.401964 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-7127b57a-a719-458f-93ef-f837a5dd102b tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:04:45.402752 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-7127b57a-a719-458f-93ef-f837a5dd102b tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:04:45.404198 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-7127b57a-a719-458f-93ef-f837a5dd102b tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:04:45.405120 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-7127b57a-a719-458f-93ef-f837a5dd102b tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:04:45.557544 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-7127b57a-a719-458f-93ef-f837a5dd102b tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:04:45.571202 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-7127b57a-a719-458f-93ef-f837a5dd102b tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:04:45.573214 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-7127b57a-a719-458f-93ef-f837a5dd102b tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:04:45.575030 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-7127b57a-a719-458f-93ef-f837a5dd102b tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] 10.222.0.47 "GET /compute/v2.1/servers/798b77ff-c3ca-4c65-a120-db12ad953621" status: 200 len: 1657 microversion: 2.20 time: 0.188178 Feb 19 05:04:45.575873 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 334/681] 10.222.0.47 () {60 vars in 1267 bytes} [Fri Feb 19 05:04:45 2021] GET /compute/v2.1/servers/798b77ff-c3ca-4c65-a120-db12ad953621 => generated 1657 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 05:04:46.143763 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [req-34dbaa46-9a26-4580-97c1-62da524236b1 req-29c05dfe-997c-427f-954e-b035afd6a02e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "798b77ff-c3ca-4c65-a120-db12ad953621", "name": "network-vif-deleted", "tag": "6af5e97b-75ed-4d80-88eb-6ea5c37a0234"}]} {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:04:46.145562 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 05:04:46.145562 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: warnings.warn(msg) Feb 19 05:04:46.163632 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [req-34dbaa46-9a26-4580-97c1-62da524236b1 req-29c05dfe-997c-427f-954e-b035afd6a02e service nova] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:04:46.164381 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [req-34dbaa46-9a26-4580-97c1-62da524236b1 req-29c05dfe-997c-427f-954e-b035afd6a02e service nova] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:04:46.207446 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.compute.server_external_events [req-34dbaa46-9a26-4580-97c1-62da524236b1 req-29c05dfe-997c-427f-954e-b035afd6a02e service nova] Creating event network-vif-deleted:6af5e97b-75ed-4d80-88eb-6ea5c37a0234 for instance 798b77ff-c3ca-4c65-a120-db12ad953621 on hv-cinder-77642 Feb 19 05:04:46.212953 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [req-34dbaa46-9a26-4580-97c1-62da524236b1 req-29c05dfe-997c-427f-954e-b035afd6a02e service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074839 Feb 19 05:04:46.213625 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 348/682] 10.222.0.47 () {64 vars in 1308 bytes} [Fri Feb 19 05:04:46 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 05:04:46.415852 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-74a36c18-3e6c-4f0d-81f9-5e9234f8577c tempest-VolumesTestJSON-1774807201 tempest-VolumesTestJSON-1774807201-project] Calling method '.version_select at 0x7f2706952b70>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:04:46.566247 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-74a36c18-3e6c-4f0d-81f9-5e9234f8577c tempest-VolumesTestJSON-1774807201 tempest-VolumesTestJSON-1774807201-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/1e4e0828-295b-4122-b280-730708038d47" status: 200 len: 350 microversion: 2.1 time: 0.154225 Feb 19 05:04:46.567563 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 335/683] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Feb 19 05:04:46 2021] GET /compute/v2.1/os-volumes/1e4e0828-295b-4122-b280-730708038d47 => generated 350 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 05:04:46.582276 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-f1ce9113-2fbe-492d-abe8-0f7ef9cb32da tempest-VolumesTestJSON-1774807201 tempest-VolumesTestJSON-1774807201-project] Calling method '.version_select at 0x7f270684e8c8>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:04:46.599533 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-b02360ce-2642-48fe-bbea-f835f7e899ca tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:04:46.600209 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-b02360ce-2642-48fe-bbea-f835f7e899ca tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] [instance: 798b77ff-c3ca-4c65-a120-db12ad953621] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:04:46.610112 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-b02360ce-2642-48fe-bbea-f835f7e899ca tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:04:46.610621 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-b02360ce-2642-48fe-bbea-f835f7e899ca tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:04:46.611544 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-b02360ce-2642-48fe-bbea-f835f7e899ca tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:04:46.612043 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-b02360ce-2642-48fe-bbea-f835f7e899ca tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:04:46.706911 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-b02360ce-2642-48fe-bbea-f835f7e899ca tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:04:46.707904 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-b02360ce-2642-48fe-bbea-f835f7e899ca tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:04:46.708593 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.objects.instance [None req-b02360ce-2642-48fe-bbea-f835f7e899ca tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lazy-loading 'fault' on Instance uuid 798b77ff-c3ca-4c65-a120-db12ad953621 {{(pid=98153) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Feb 19 05:04:46.763007 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-f1ce9113-2fbe-492d-abe8-0f7ef9cb32da tempest-VolumesTestJSON-1774807201 tempest-VolumesTestJSON-1774807201-project] 10.222.0.47 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.186780 Feb 19 05:04:46.765047 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 349/684] 10.222.0.47 () {58 vars in 1124 bytes} [Fri Feb 19 05:04:46 2021] GET /compute/v2.1/os-volumes => generated 1035 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:04:46.777857 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-776a9454-0842-4854-9cfc-a3f4cebcc189 tempest-VolumesTestJSON-1774807201 tempest-VolumesTestJSON-1774807201-project] Calling method '.version_select at 0x7f27064fde18>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:04:46.843181 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-b02360ce-2642-48fe-bbea-f835f7e899ca tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:04:46.865546 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-b02360ce-2642-48fe-bbea-f835f7e899ca tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:04:46.865546 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-b02360ce-2642-48fe-bbea-f835f7e899ca tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:04:46.865546 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-b02360ce-2642-48fe-bbea-f835f7e899ca tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] 10.222.0.47 "GET /compute/v2.1/servers/798b77ff-c3ca-4c65-a120-db12ad953621" status: 200 len: 1372 microversion: 2.20 time: 0.267037 Feb 19 05:04:46.865863 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 336/685] 10.222.0.47 () {60 vars in 1267 bytes} [Fri Feb 19 05:04:46 2021] GET /compute/v2.1/servers/798b77ff-c3ca-4c65-a120-db12ad953621 => generated 1372 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 05:04:46.960833 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-776a9454-0842-4854-9cfc-a3f4cebcc189 tempest-VolumesTestJSON-1774807201 tempest-VolumesTestJSON-1774807201-project] 10.222.0.47 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.186411 Feb 19 05:04:46.962433 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 350/686] 10.222.0.47 () {58 vars in 1139 bytes} [Fri Feb 19 05:04:46 2021] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 05:04:46.996426 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-6f9cf68c-5df1-4fee-8bed-ba90f929b0e6 tempest-VolumesTestJSON-1774807201 tempest-VolumesTestJSON-1774807201-project] Calling method '.version_select at 0x7f270bb48510>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:04:47.146555 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-6f9cf68c-5df1-4fee-8bed-ba90f929b0e6 tempest-VolumesTestJSON-1774807201 tempest-VolumesTestJSON-1774807201-project] 10.222.0.47 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.166609 Feb 19 05:04:47.160598 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 337/687] 10.222.0.47 () {58 vars in 1124 bytes} [Fri Feb 19 05:04:46 2021] GET /compute/v2.1/os-volumes => generated 1035 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:04:47.175820 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-d768102a-4d0a-4bbf-b84b-08502b1aa297 tempest-VolumesTestJSON-1774807201 tempest-VolumesTestJSON-1774807201-project] Calling method '.version_select at 0x7f27064fdbf8>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:04:47.384820 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-d768102a-4d0a-4bbf-b84b-08502b1aa297 tempest-VolumesTestJSON-1774807201 tempest-VolumesTestJSON-1774807201-project] 10.222.0.47 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.218140 Feb 19 05:04:47.385431 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 351/688] 10.222.0.47 () {58 vars in 1157 bytes} [Fri Feb 19 05:04:47 2021] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 05:04:47.399304 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-a3866930-2d4e-4800-b4a3-2c184df5ad06 tempest-VolumesTestJSON-1774807201 tempest-VolumesTestJSON-1774807201-project] Calling method '.version_select at 0x7f2706a3ad08>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:04:47.513573 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-a3866930-2d4e-4800-b4a3-2c184df5ad06 tempest-VolumesTestJSON-1774807201 tempest-VolumesTestJSON-1774807201-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.118034 Feb 19 05:04:47.514930 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 338/689] 10.222.0.47 () {58 vars in 1160 bytes} [Fri Feb 19 05:04:47 2021] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 05:04:47.529046 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-0fd9e64c-e3f8-4af4-a0d9-0ffb79d7ca85 tempest-VolumesTestJSON-1774807201 tempest-VolumesTestJSON-1774807201-project] Calling method '.version_select at 0x7f27064fd730>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:04:47.646047 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-0fd9e64c-e3f8-4af4-a0d9-0ffb79d7ca85 tempest-VolumesTestJSON-1774807201 tempest-VolumesTestJSON-1774807201-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.121028 Feb 19 05:04:47.654412 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 352/690] 10.222.0.47 () {58 vars in 1145 bytes} [Fri Feb 19 05:04:47 2021] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:04:47.661663 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-66202efa-ebe4-4550-8a02-b5d4d932d02d tempest-VolumesTestJSON-1774807201 tempest-VolumesTestJSON-1774807201-project] Calling method '.version_select at 0x7f2706952ae8>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:04:47.777460 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-66202efa-ebe4-4550-8a02-b5d4d932d02d tempest-VolumesTestJSON-1774807201 tempest-VolumesTestJSON-1774807201-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.121056 Feb 19 05:04:47.778250 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 339/691] 10.222.0.47 () {58 vars in 1178 bytes} [Fri Feb 19 05:04:47 2021] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 19 05:04:47.796790 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-23490377-6518-4529-acf6-07c4ad09030e tempest-VolumesTestJSON-1774807201 tempest-VolumesTestJSON-1774807201-project] Calling method '.version_select at 0x7f270bacf158>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:04:47.887519 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-9efebc7f-b5e5-4946-abf5-3db41bf52fa6 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:04:47.888423 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-9efebc7f-b5e5-4946-abf5-3db41bf52fa6 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] [instance: 798b77ff-c3ca-4c65-a120-db12ad953621] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:04:47.899560 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-9efebc7f-b5e5-4946-abf5-3db41bf52fa6 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:04:47.900385 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-9efebc7f-b5e5-4946-abf5-3db41bf52fa6 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:04:47.901513 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-9efebc7f-b5e5-4946-abf5-3db41bf52fa6 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:04:47.902156 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-9efebc7f-b5e5-4946-abf5-3db41bf52fa6 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:04:47.934586 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-23490377-6518-4529-acf6-07c4ad09030e tempest-VolumesTestJSON-1774807201 tempest-VolumesTestJSON-1774807201-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.143899 Feb 19 05:04:47.935443 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 353/692] 10.222.0.47 () {58 vars in 1145 bytes} [Fri Feb 19 05:04:47 2021] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:04:48.026831 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.wsgi [None req-9efebc7f-b5e5-4946-abf5-3db41bf52fa6 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] HTTP exception thrown: Instance 798b77ff-c3ca-4c65-a120-db12ad953621 could not be found. Feb 19 05:04:48.027777 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-9efebc7f-b5e5-4946-abf5-3db41bf52fa6 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Returning 404 to user: Instance 798b77ff-c3ca-4c65-a120-db12ad953621 could not be found. {{(pid=98153) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 19 05:04:48.029008 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-9efebc7f-b5e5-4946-abf5-3db41bf52fa6 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] 10.222.0.47 "GET /compute/v2.1/servers/798b77ff-c3ca-4c65-a120-db12ad953621" status: 404 len: 111 microversion: 2.20 time: 0.146006 Feb 19 05:04:48.030211 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 340/693] 10.222.0.47 () {60 vars in 1267 bytes} [Fri Feb 19 05:04:47 2021] GET /compute/v2.1/servers/798b77ff-c3ca-4c65-a120-db12ad953621 => generated 111 bytes in 148 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Feb 19 05:04:48.041014 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-a809feec-4a5b-4453-8c79-76cdb5124356 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Calling method '.version_select at 0x7f270684e0d0>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:04:48.072160 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-a809feec-4a5b-4453-8c79-76cdb5124356 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2097827461" status: 204 len: 0 microversion: 2.20 time: 0.035608 Feb 19 05:04:48.072160 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 354/694] 10.222.0.47 () {60 vars in 1252 bytes} [Fri Feb 19 05:04:48 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2097827461 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Feb 19 05:04:48.574491 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-0e734b00-a756-49dc-a1aa-7bfdade45c68 tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:04:48.575303 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-0e734b00-a756-49dc-a1aa-7bfdade45c68 tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] [instance: be41f685-0cdd-4413-8467-43335bd91c60] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:04:48.584479 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-0e734b00-a756-49dc-a1aa-7bfdade45c68 tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:04:48.584990 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-0e734b00-a756-49dc-a1aa-7bfdade45c68 tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:04:48.585878 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-0e734b00-a756-49dc-a1aa-7bfdade45c68 tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:04:48.586340 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-0e734b00-a756-49dc-a1aa-7bfdade45c68 tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:04:48.836361 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.objects.instance [None req-0e734b00-a756-49dc-a1aa-7bfdade45c68 tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Lazy-loading 'services' on Instance uuid be41f685-0cdd-4413-8467-43335bd91c60 {{(pid=98153) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Feb 19 05:04:49.173123 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-0e734b00-a756-49dc-a1aa-7bfdade45c68 tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] 10.222.0.47 "DELETE /compute/v2.1/servers/be41f685-0cdd-4413-8467-43335bd91c60/os-volume_attachments/488cb9d0-0b5a-49b4-9680-c7aaffde9cf0" status: 202 len: 0 microversion: 2.1 time: 0.603276 Feb 19 05:04:49.174207 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 341/695] 10.222.0.47 () {58 vars in 1406 bytes} [Fri Feb 19 05:04:48 2021] DELETE /compute/v2.1/servers/be41f685-0cdd-4413-8467-43335bd91c60/os-volume_attachments/488cb9d0-0b5a-49b4-9680-c7aaffde9cf0 => generated 0 bytes in 605 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 19 05:04:50.527670 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-fd410f9e-1b75-44db-8326-8793ec57d210 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:04:50.529130 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-fd410f9e-1b75-44db-8326-8793ec57d210 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] [instance: 0ae0d266-c297-45f1-80fe-0e8f84cc22e6] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:04:50.539002 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-fd410f9e-1b75-44db-8326-8793ec57d210 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:04:50.539979 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-fd410f9e-1b75-44db-8326-8793ec57d210 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:04:50.541154 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-fd410f9e-1b75-44db-8326-8793ec57d210 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:04:50.541714 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-fd410f9e-1b75-44db-8326-8793ec57d210 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:04:50.881155 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-fd410f9e-1b75-44db-8326-8793ec57d210 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5df26a2a7e854705800096f12d30c8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3309eb07e18a46a2a0bcbde1f9e46dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:04:50.892442 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-02d5b376-6c47-4507-9de3-b613b4bb95ca tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Action: 'create', calling method: .version_select at 0x7f2706562ae8>, body: {"keypair": {"name": "tempest-keypair-1501241439"}} {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:04:50.893276 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-fd410f9e-1b75-44db-8326-8793ec57d210 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] 10.222.0.47 "GET /compute/v2.1/servers/0ae0d266-c297-45f1-80fe-0e8f84cc22e6" status: 200 len: 1593 microversion: 2.1 time: 0.371215 Feb 19 05:04:50.894075 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 355/696] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:04:50 2021] GET /compute/v2.1/servers/0ae0d266-c297-45f1-80fe-0e8f84cc22e6 => generated 1593 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:04:50.913312 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-93d4b3e9-c8b4-4ae9-b012-220180c87588 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Action: 'create', calling method: .version_select at 0x7f270bacf8c8>, body: {"pool": null} {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:04:50.928812 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.quota [None req-02d5b376-6c47-4507-9de3-b613b4bb95ca tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Getting quotas for project 2441d2c3fda643489d511f8ba26e9755. Resources: {'key_pairs'} {{(pid=98153) _get_quotas /opt/stack/nova/nova/quota.py:388}} Feb 19 05:04:50.933536 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.quota [None req-02d5b376-6c47-4507-9de3-b613b4bb95ca tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Getting quotas for user 62fa02eb0f4e42b3a536230807e2786d and project 2441d2c3fda643489d511f8ba26e9755. Resources: {'key_pairs'} {{(pid=98153) _get_quotas /opt/stack/nova/nova/quota.py:380}} Feb 19 05:04:51.235889 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.quota [None req-02d5b376-6c47-4507-9de3-b613b4bb95ca tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Getting quotas for project 2441d2c3fda643489d511f8ba26e9755. Resources: {'key_pairs'} {{(pid=98153) _get_quotas /opt/stack/nova/nova/quota.py:388}} Feb 19 05:04:51.240175 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.quota [None req-02d5b376-6c47-4507-9de3-b613b4bb95ca tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Getting quotas for user 62fa02eb0f4e42b3a536230807e2786d and project 2441d2c3fda643489d511f8ba26e9755. Resources: {'key_pairs'} {{(pid=98153) _get_quotas /opt/stack/nova/nova/quota.py:380}} Feb 19 05:04:51.254858 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-02d5b376-6c47-4507-9de3-b613b4bb95ca tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 201 len: 2316 microversion: 2.20 time: 0.367800 Feb 19 05:04:51.255778 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 342/697] 10.222.0.47 () {62 vars in 1189 bytes} [Fri Feb 19 05:04:50 2021] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 370 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Feb 19 05:04:51.737519 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-00870854-9db3-410f-b993-7b7c075167c0 tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:04:51.738626 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-00870854-9db3-410f-b993-7b7c075167c0 tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] [instance: be41f685-0cdd-4413-8467-43335bd91c60] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:04:51.747639 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-00870854-9db3-410f-b993-7b7c075167c0 tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:04:51.748238 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-00870854-9db3-410f-b993-7b7c075167c0 tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:04:51.749733 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-00870854-9db3-410f-b993-7b7c075167c0 tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:04:51.750319 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-00870854-9db3-410f-b993-7b7c075167c0 tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:04:51.847685 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-00870854-9db3-410f-b993-7b7c075167c0 tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] [instance: be41f685-0cdd-4413-8467-43335bd91c60] Going to try to terminate instance {{(pid=98153) delete /opt/stack/nova/nova/compute/api.py:2540}} Feb 19 05:04:52.005223 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-00870854-9db3-410f-b993-7b7c075167c0 tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] 10.222.0.47 "DELETE /compute/v2.1/servers/be41f685-0cdd-4413-8467-43335bd91c60" status: 204 len: 0 microversion: 2.1 time: 0.270652 Feb 19 05:04:52.006148 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 343/698] 10.222.0.47 () {58 vars in 1229 bytes} [Fri Feb 19 05:04:51 2021] DELETE /compute/v2.1/servers/be41f685-0cdd-4413-8467-43335bd91c60 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Feb 19 05:04:52.019640 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-a13f6c02-17f5-439f-b53f-4ac5a1b49fb1 tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:04:52.020550 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-a13f6c02-17f5-439f-b53f-4ac5a1b49fb1 tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] [instance: be41f685-0cdd-4413-8467-43335bd91c60] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:04:52.028245 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-a13f6c02-17f5-439f-b53f-4ac5a1b49fb1 tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:04:52.028648 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-a13f6c02-17f5-439f-b53f-4ac5a1b49fb1 tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:04:52.029614 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-a13f6c02-17f5-439f-b53f-4ac5a1b49fb1 tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:04:52.030366 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-a13f6c02-17f5-439f-b53f-4ac5a1b49fb1 tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:04:52.480747 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-a13f6c02-17f5-439f-b53f-4ac5a1b49fb1 tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '876d82b7755b4c1f91c8ad200c0f567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b461024d8cdf4d5c966d746682381d79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:04:52.491936 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-a13f6c02-17f5-439f-b53f-4ac5a1b49fb1 tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] 10.222.0.47 "GET /compute/v2.1/servers/be41f685-0cdd-4413-8467-43335bd91c60" status: 200 len: 1513 microversion: 2.1 time: 0.478908 Feb 19 05:04:52.492803 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 344/699] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:04:52 2021] GET /compute/v2.1/servers/be41f685-0cdd-4413-8467-43335bd91c60 => generated 1513 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:04:53.510549 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-99dfe2c3-c3dd-47b0-aba2-60469901e68c tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:04:53.511931 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-99dfe2c3-c3dd-47b0-aba2-60469901e68c tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] [instance: be41f685-0cdd-4413-8467-43335bd91c60] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:04:53.521066 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-99dfe2c3-c3dd-47b0-aba2-60469901e68c tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:04:53.521933 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-99dfe2c3-c3dd-47b0-aba2-60469901e68c tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:04:53.523478 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-99dfe2c3-c3dd-47b0-aba2-60469901e68c tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:04:53.523730 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-99dfe2c3-c3dd-47b0-aba2-60469901e68c tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:04:54.036209 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-93d4b3e9-c8b4-4ae9-b012-220180c87588 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] 10.222.0.47 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 3.126262 Feb 19 05:04:54.037616 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 356/700] 10.222.0.47 () {60 vars in 1160 bytes} [Fri Feb 19 05:04:50 2021] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 3129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 19 05:04:54.062914 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-ef665c23-d34c-434f-ab4f-2d5f91ea22d7 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Action: 'action', calling method: .version_select at 0x7f27087ba950>, body: {"addFloatingIp": {"address": "172.27.0.97"}} {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:04:54.064366 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-ef665c23-d34c-434f-ab4f-2d5f91ea22d7 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] [instance: 0ae0d266-c297-45f1-80fe-0e8f84cc22e6] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:04:54.073783 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-ef665c23-d34c-434f-ab4f-2d5f91ea22d7 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:04:54.074286 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-ef665c23-d34c-434f-ab4f-2d5f91ea22d7 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:04:54.075580 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-ef665c23-d34c-434f-ab4f-2d5f91ea22d7 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:04:54.076329 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-ef665c23-d34c-434f-ab4f-2d5f91ea22d7 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:04:54.158292 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-ef665c23-d34c-434f-ab4f-2d5f91ea22d7 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Acquired lock "refresh_cache-0ae0d266-c297-45f1-80fe-0e8f84cc22e6" {{(pid=98154) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:266}} Feb 19 05:04:54.232076 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-99dfe2c3-c3dd-47b0-aba2-60469901e68c tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '876d82b7755b4c1f91c8ad200c0f567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b461024d8cdf4d5c966d746682381d79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:04:54.243194 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-99dfe2c3-c3dd-47b0-aba2-60469901e68c tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] 10.222.0.47 "GET /compute/v2.1/servers/be41f685-0cdd-4413-8467-43335bd91c60" status: 200 len: 1513 microversion: 2.1 time: 0.736685 Feb 19 05:04:54.244175 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 345/701] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:04:53 2021] GET /compute/v2.1/servers/be41f685-0cdd-4413-8467-43335bd91c60 => generated 1513 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:04:54.412559 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-db933c95-c046-40ac-9358-a5132b428408 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-957935661", "imageRef": "53cdf9de-e495-4ca8-845f-6be2bf32cecb", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f2977b0e-aa44-47dc-b320-3e70742849f6"}], "security_groups": [{"name": "tempest-securitygroup--195391175"}], "key_name": "tempest-keypair-1501241439", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:04:55.035101 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.network.neutron [None req-db933c95-c046-40ac-9358-a5132b428408 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] validate_networks() for [('f2977b0e-aa44-47dc-b320-3e70742849f6', None, None, None)] {{(pid=98153) validate_networks /opt/stack/nova/nova/network/neutron.py:2345}} Feb 19 05:04:57.737565 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.virt.hardware [None req-db933c95-c046-40ac-9358-a5132b428408 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Flavor limits 0:0:0 {{(pid=98153) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 19 05:04:57.738025 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.virt.hardware [None req-db933c95-c046-40ac-9358-a5132b428408 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Image limits 0:0:0 {{(pid=98153) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Feb 19 05:04:57.738877 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.virt.hardware [None req-db933c95-c046-40ac-9358-a5132b428408 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Flavor pref 0:0:0 {{(pid=98153) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 19 05:04:57.739558 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.virt.hardware [None req-db933c95-c046-40ac-9358-a5132b428408 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Image pref 0:0:0 {{(pid=98153) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Feb 19 05:04:57.740033 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.virt.hardware [None req-db933c95-c046-40ac-9358-a5132b428408 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98153) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Feb 19 05:04:57.753805 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-db933c95-c046-40ac-9358-a5132b428408 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:04:57.754315 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-db933c95-c046-40ac-9358-a5132b428408 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:04:57.755196 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-db933c95-c046-40ac-9358-a5132b428408 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:04:57.755736 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-db933c95-c046-40ac-9358-a5132b428408 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:04:57.778946 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.quota [None req-db933c95-c046-40ac-9358-a5132b428408 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Getting quotas for project 2441d2c3fda643489d511f8ba26e9755. Resources: {'instances', 'ram', 'cores'} {{(pid=98153) _get_quotas /opt/stack/nova/nova/quota.py:388}} Feb 19 05:04:57.786200 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.quota [None req-db933c95-c046-40ac-9358-a5132b428408 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Getting quotas for user 62fa02eb0f4e42b3a536230807e2786d and project 2441d2c3fda643489d511f8ba26e9755. Resources: {'instances', 'ram', 'cores'} {{(pid=98153) _get_quotas /opt/stack/nova/nova/quota.py:380}} Feb 19 05:04:57.803218 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-db933c95-c046-40ac-9358-a5132b428408 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Going to run 1 instances... {{(pid=98153) _provision_instances /opt/stack/nova/nova/compute/api.py:1264}} Feb 19 05:04:57.806135 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-db933c95-c046-40ac-9358-a5132b428408 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] [instance: dcb11872-0660-4e35-8d91-bfe80088844b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='53cdf9de-e495-4ca8-845f-6be2bf32cecb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98153) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1666}} Feb 19 05:04:57.880962 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-db933c95-c046-40ac-9358-a5132b428408 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 3.476081 Feb 19 05:04:57.881797 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 346/702] 10.222.0.47 () {62 vars in 1178 bytes} [Fri Feb 19 05:04:54 2021] POST /compute/v2.1/servers => generated 401 bytes in 3478 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Feb 19 05:04:57.893858 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-4e857913-35c3-4bd5-876b-324ec9bdf75a tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:04:57.894634 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-4e857913-35c3-4bd5-876b-324ec9bdf75a tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] [instance: be41f685-0cdd-4413-8467-43335bd91c60] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:04:57.902880 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-4e857913-35c3-4bd5-876b-324ec9bdf75a tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:04:57.903514 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-4e857913-35c3-4bd5-876b-324ec9bdf75a tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:04:57.904543 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-4e857913-35c3-4bd5-876b-324ec9bdf75a tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:04:57.905392 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-4e857913-35c3-4bd5-876b-324ec9bdf75a tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:04:58.800394 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-4e857913-35c3-4bd5-876b-324ec9bdf75a tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '876d82b7755b4c1f91c8ad200c0f567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b461024d8cdf4d5c966d746682381d79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:04:58.810893 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-4e857913-35c3-4bd5-876b-324ec9bdf75a tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] 10.222.0.47 "GET /compute/v2.1/servers/be41f685-0cdd-4413-8467-43335bd91c60" status: 200 len: 1513 microversion: 2.1 time: 0.921733 Feb 19 05:04:58.811768 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 347/703] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:04:57 2021] GET /compute/v2.1/servers/be41f685-0cdd-4413-8467-43335bd91c60 => generated 1513 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:04:58.818120 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [req-dd15d622-4368-45e7-af74-0d5ef8031baf req-9e01250a-92af-4c02-b9d6-1d4d5ab02e73 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be41f685-0cdd-4413-8467-43335bd91c60", "name": "network-vif-unplugged", "status": "completed", "tag": "39419b9e-6a2f-43bc-aa28-83a27266718d"}]} {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:04:58.820904 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 05:04:58.820904 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: warnings.warn(msg) Feb 19 05:04:58.834414 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [req-dd15d622-4368-45e7-af74-0d5ef8031baf req-9e01250a-92af-4c02-b9d6-1d4d5ab02e73 service nova] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:04:58.835127 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [req-dd15d622-4368-45e7-af74-0d5ef8031baf req-9e01250a-92af-4c02-b9d6-1d4d5ab02e73 service nova] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:04:58.855123 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.compute.server_external_events [req-dd15d622-4368-45e7-af74-0d5ef8031baf req-9e01250a-92af-4c02-b9d6-1d4d5ab02e73 service nova] Creating event network-vif-unplugged:39419b9e-6a2f-43bc-aa28-83a27266718d for instance be41f685-0cdd-4413-8467-43335bd91c60 on hv-cinder-77642 Feb 19 05:04:58.861927 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [req-dd15d622-4368-45e7-af74-0d5ef8031baf req-9e01250a-92af-4c02-b9d6-1d4d5ab02e73 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048084 Feb 19 05:04:58.863057 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 348/704] 10.222.0.47 () {64 vars in 1308 bytes} [Fri Feb 19 05:04:58 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 05:04:58.869020 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-9bc1f841-8021-41eb-b068-7139bd2862d9 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:04:58.870385 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-9bc1f841-8021-41eb-b068-7139bd2862d9 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] [instance: dcb11872-0660-4e35-8d91-bfe80088844b] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:04:58.880457 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-9bc1f841-8021-41eb-b068-7139bd2862d9 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:04:58.881137 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-9bc1f841-8021-41eb-b068-7139bd2862d9 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:04:58.882132 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-9bc1f841-8021-41eb-b068-7139bd2862d9 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:04:58.882951 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-9bc1f841-8021-41eb-b068-7139bd2862d9 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:04:59.118023 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.network.neutron [None req-ef665c23-d34c-434f-ab4f-2d5f91ea22d7 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] [instance: 0ae0d266-c297-45f1-80fe-0e8f84cc22e6] Building network info cache for instance {{(pid=98154) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1836}} Feb 19 05:04:59.148617 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-9bc1f841-8021-41eb-b068-7139bd2862d9 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:04:59.164891 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-9bc1f841-8021-41eb-b068-7139bd2862d9 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:04:59.166717 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-9bc1f841-8021-41eb-b068-7139bd2862d9 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:04:59.168031 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-9bc1f841-8021-41eb-b068-7139bd2862d9 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] 10.222.0.47 "GET /compute/v2.1/servers/dcb11872-0660-4e35-8d91-bfe80088844b" status: 200 len: 1277 microversion: 2.20 time: 0.303567 Feb 19 05:04:59.168676 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 349/705] 10.222.0.47 () {60 vars in 1267 bytes} [Fri Feb 19 05:04:58 2021] GET /compute/v2.1/servers/dcb11872-0660-4e35-8d91-bfe80088844b => generated 1277 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 05:04:59.182150 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [req-8556da05-4a84-4c1c-b2be-485858472af7 req-729c3f30-85ac-4575-afc3-144529ad44c1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ae0d266-c297-45f1-80fe-0e8f84cc22e6", "tag": "fa4d6bd7-26d3-4df0-ac31-ae6f1438d6f5"}]} {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:04:59.184149 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 05:04:59.184149 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: warnings.warn(msg) Feb 19 05:04:59.204633 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [req-8556da05-4a84-4c1c-b2be-485858472af7 req-729c3f30-85ac-4575-afc3-144529ad44c1 service nova] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:04:59.205270 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [req-8556da05-4a84-4c1c-b2be-485858472af7 req-729c3f30-85ac-4575-afc3-144529ad44c1 service nova] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:04:59.239025 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.compute.server_external_events [req-8556da05-4a84-4c1c-b2be-485858472af7 req-729c3f30-85ac-4575-afc3-144529ad44c1 service nova] Creating event network-changed:fa4d6bd7-26d3-4df0-ac31-ae6f1438d6f5 for instance 0ae0d266-c297-45f1-80fe-0e8f84cc22e6 on hv-cinder-77642 Feb 19 05:04:59.245117 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [req-8556da05-4a84-4c1c-b2be-485858472af7 req-729c3f30-85ac-4575-afc3-144529ad44c1 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074801 Feb 19 05:04:59.246201 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 350/706] 10.222.0.47 () {64 vars in 1308 bytes} [Fri Feb 19 05:04:59 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 05:04:59.831212 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-2a7c843c-2484-46a7-ab04-a27473a3ba56 tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:04:59.832220 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-2a7c843c-2484-46a7-ab04-a27473a3ba56 tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] [instance: be41f685-0cdd-4413-8467-43335bd91c60] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:04:59.853702 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-2a7c843c-2484-46a7-ab04-a27473a3ba56 tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:04:59.856086 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-2a7c843c-2484-46a7-ab04-a27473a3ba56 tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:04:59.857180 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-2a7c843c-2484-46a7-ab04-a27473a3ba56 tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:04:59.859727 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-2a7c843c-2484-46a7-ab04-a27473a3ba56 tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:05:00.112308 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-2a7c843c-2484-46a7-ab04-a27473a3ba56 tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:05:00.112946 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-2a7c843c-2484-46a7-ab04-a27473a3ba56 tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:05:00.113591 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.objects.instance [None req-2a7c843c-2484-46a7-ab04-a27473a3ba56 tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Lazy-loading 'fault' on Instance uuid be41f685-0cdd-4413-8467-43335bd91c60 {{(pid=98153) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Feb 19 05:05:00.431553 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-2a7c843c-2484-46a7-ab04-a27473a3ba56 tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '876d82b7755b4c1f91c8ad200c0f567f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b461024d8cdf4d5c966d746682381d79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:05:00.443770 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-2a7c843c-2484-46a7-ab04-a27473a3ba56 tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] 10.222.0.47 "GET /compute/v2.1/servers/be41f685-0cdd-4413-8467-43335bd91c60" status: 200 len: 1308 microversion: 2.1 time: 0.617923 Feb 19 05:05:00.466664 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 351/707] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:04:59 2021] GET /compute/v2.1/servers/be41f685-0cdd-4413-8467-43335bd91c60 => generated 1308 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 05:05:00.489494 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-d9cfb40c-5409-4fea-8c21-c9861f78b51f tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:05:00.490941 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-d9cfb40c-5409-4fea-8c21-c9861f78b51f tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] [instance: dcb11872-0660-4e35-8d91-bfe80088844b] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:05:00.501249 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-d9cfb40c-5409-4fea-8c21-c9861f78b51f tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:05:00.501767 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-d9cfb40c-5409-4fea-8c21-c9861f78b51f tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:05:00.502640 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-d9cfb40c-5409-4fea-8c21-c9861f78b51f tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:05:00.503137 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-d9cfb40c-5409-4fea-8c21-c9861f78b51f tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:05:00.737564 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-d9cfb40c-5409-4fea-8c21-c9861f78b51f tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:05:00.753900 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-d9cfb40c-5409-4fea-8c21-c9861f78b51f tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:05:00.756982 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-d9cfb40c-5409-4fea-8c21-c9861f78b51f tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:05:00.760096 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-d9cfb40c-5409-4fea-8c21-c9861f78b51f tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] 10.222.0.47 "GET /compute/v2.1/servers/dcb11872-0660-4e35-8d91-bfe80088844b" status: 200 len: 1339 microversion: 2.20 time: 0.285532 Feb 19 05:05:00.765366 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 352/708] 10.222.0.47 () {60 vars in 1267 bytes} [Fri Feb 19 05:05:00 2021] GET /compute/v2.1/servers/dcb11872-0660-4e35-8d91-bfe80088844b => generated 1339 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 05:05:01.474532 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-7c216f31-96b9-4be1-a3eb-fe8a1ef7fc8d tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:05:01.475224 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-7c216f31-96b9-4be1-a3eb-fe8a1ef7fc8d tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] [instance: be41f685-0cdd-4413-8467-43335bd91c60] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:05:01.486977 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-7c216f31-96b9-4be1-a3eb-fe8a1ef7fc8d tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:05:01.487772 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-7c216f31-96b9-4be1-a3eb-fe8a1ef7fc8d tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:05:01.489017 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-7c216f31-96b9-4be1-a3eb-fe8a1ef7fc8d tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:05:01.489656 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-7c216f31-96b9-4be1-a3eb-fe8a1ef7fc8d tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:05:01.560361 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.wsgi [None req-7c216f31-96b9-4be1-a3eb-fe8a1ef7fc8d tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] HTTP exception thrown: Instance be41f685-0cdd-4413-8467-43335bd91c60 could not be found. Feb 19 05:05:01.563271 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-7c216f31-96b9-4be1-a3eb-fe8a1ef7fc8d tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] Returning 404 to user: Instance be41f685-0cdd-4413-8467-43335bd91c60 could not be found. {{(pid=98153) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 19 05:05:01.565353 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-7c216f31-96b9-4be1-a3eb-fe8a1ef7fc8d tempest-VolumesSnapshotTestJSON-1342714922 tempest-VolumesSnapshotTestJSON-1342714922-project] 10.222.0.47 "GET /compute/v2.1/servers/be41f685-0cdd-4413-8467-43335bd91c60" status: 404 len: 111 microversion: 2.1 time: 0.095325 Feb 19 05:05:01.566777 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 353/709] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:05:01 2021] GET /compute/v2.1/servers/be41f685-0cdd-4413-8467-43335bd91c60 => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Feb 19 05:05:01.585288 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [req-76ec8f72-b414-4f6c-a203-a6a8c3dbcb01 req-f0d4cce9-98aa-4d8a-8786-03062c4841a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be41f685-0cdd-4413-8467-43335bd91c60", "name": "network-vif-deleted", "tag": "39419b9e-6a2f-43bc-aa28-83a27266718d"}]} {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:05:01.587384 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 05:05:01.587384 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: warnings.warn(msg) Feb 19 05:05:01.599487 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [req-76ec8f72-b414-4f6c-a203-a6a8c3dbcb01 req-f0d4cce9-98aa-4d8a-8786-03062c4841a4 service nova] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:05:01.600235 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [req-76ec8f72-b414-4f6c-a203-a6a8c3dbcb01 req-f0d4cce9-98aa-4d8a-8786-03062c4841a4 service nova] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:05:01.627311 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.compute.server_external_events [req-76ec8f72-b414-4f6c-a203-a6a8c3dbcb01 req-f0d4cce9-98aa-4d8a-8786-03062c4841a4 service nova] Creating event network-vif-deleted:39419b9e-6a2f-43bc-aa28-83a27266718d for instance be41f685-0cdd-4413-8467-43335bd91c60 on hv-cinder-77642 Feb 19 05:05:01.633737 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [req-76ec8f72-b414-4f6c-a203-a6a8c3dbcb01 req-f0d4cce9-98aa-4d8a-8786-03062c4841a4 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064978 Feb 19 05:05:01.634741 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 354/710] 10.222.0.47 () {64 vars in 1308 bytes} [Fri Feb 19 05:05:01 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 05:05:01.801019 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-7482b37b-1eb6-4d85-ab03-9e03f099c451 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:05:01.802397 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-7482b37b-1eb6-4d85-ab03-9e03f099c451 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] [instance: dcb11872-0660-4e35-8d91-bfe80088844b] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:05:01.823443 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-7482b37b-1eb6-4d85-ab03-9e03f099c451 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:05:01.828534 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-7482b37b-1eb6-4d85-ab03-9e03f099c451 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:05:01.831164 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-7482b37b-1eb6-4d85-ab03-9e03f099c451 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:05:01.832030 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-7482b37b-1eb6-4d85-ab03-9e03f099c451 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:05:01.948953 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.network.neutron [None req-ef665c23-d34c-434f-ab4f-2d5f91ea22d7 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] [instance: 0ae0d266-c297-45f1-80fe-0e8f84cc22e6] Updating instance_info_cache with network_info: [{"id": "fa4d6bd7-26d3-4df0-ac31-ae6f1438d6f5", "address": "fa:16:3e:8e:ea:b2", "network": {"id": "5cb4ec90-ce43-4ddc-ac74-490620baaffe", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1740998779-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.27.0.97", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "3309eb07e18a46a2a0bcbde1f9e46dd8", "mtu": 1450, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, "devname": "tapfa4d6bd7-26", "ovs_interfaceid": "fa4d6bd7-26d3-4df0-ac31-ae6f1438d6f5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "meta": {}}] {{(pid=98154) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Feb 19 05:05:01.981703 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-ef665c23-d34c-434f-ab4f-2d5f91ea22d7 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Releasing lock "refresh_cache-0ae0d266-c297-45f1-80fe-0e8f84cc22e6" {{(pid=98154) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:282}} Feb 19 05:05:01.982636 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-ef665c23-d34c-434f-ab4f-2d5f91ea22d7 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] 10.222.0.47 "POST /compute/v2.1/servers/0ae0d266-c297-45f1-80fe-0e8f84cc22e6/action" status: 202 len: 0 microversion: 2.1 time: 7.925134 Feb 19 05:05:01.983381 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 357/711] 10.222.0.47 () {60 vars in 1268 bytes} [Fri Feb 19 05:04:54 2021] POST /compute/v2.1/servers/0ae0d266-c297-45f1-80fe-0e8f84cc22e6/action => generated 0 bytes in 7926 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Feb 19 05:05:02.006269 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-ea3169bb-3b19-4ba0-82fd-57b866edf3cc tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Action: 'create', calling method: .version_select at 0x7f270bacf268>, body: {"security_group": {"name": "tempest-TestMinimumBasicScenario-2031567781", "description": "tempest-TestMinimumBasicScenario-2031567781 description"}} {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:05:02.307642 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-7482b37b-1eb6-4d85-ab03-9e03f099c451 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:05:02.337139 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-7482b37b-1eb6-4d85-ab03-9e03f099c451 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:05:02.354615 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-7482b37b-1eb6-4d85-ab03-9e03f099c451 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:05:02.356055 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-7482b37b-1eb6-4d85-ab03-9e03f099c451 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] 10.222.0.47 "GET /compute/v2.1/servers/dcb11872-0660-4e35-8d91-bfe80088844b" status: 200 len: 1406 microversion: 2.20 time: 0.562492 Feb 19 05:05:02.357167 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 355/712] 10.222.0.47 () {60 vars in 1267 bytes} [Fri Feb 19 05:05:01 2021] GET /compute/v2.1/servers/dcb11872-0660-4e35-8d91-bfe80088844b => generated 1406 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 05:05:02.470163 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-ea3169bb-3b19-4ba0-82fd-57b866edf3cc tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] 10.222.0.47 "POST /compute/v2.1/os-security-groups" status: 200 len: 257 microversion: 2.1 time: 0.477186 Feb 19 05:05:02.470827 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 358/713] 10.222.0.47 () {60 vars in 1170 bytes} [Fri Feb 19 05:05:01 2021] POST /compute/v2.1/os-security-groups => generated 257 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 05:05:02.485055 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-db706dfe-67b4-4ff1-89b5-ad0c1318b365 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Action: 'create', calling method: .version_select at 0x7f2708560840>, body: {"security_group_rule": {"parent_group_id": "e28a7a56-f099-4d02-befc-b2472b7b4da5", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "cidr": "0.0.0.0/0"}} {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:05:02.738748 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-db706dfe-67b4-4ff1-89b5-ad0c1318b365 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] 10.222.0.47 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.259007 Feb 19 05:05:02.743364 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 356/714] 10.222.0.47 () {60 vars in 1185 bytes} [Fri Feb 19 05:05:02 2021] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 05:05:02.750955 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-5934f74a-5b41-43bf-8641-54f98457cfad tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Action: 'create', calling method: .version_select at 0x7f27064fdb70>, body: {"security_group_rule": {"parent_group_id": "e28a7a56-f099-4d02-befc-b2472b7b4da5", "ip_protocol": "icmp", "from_port": -1, "to_port": -1, "cidr": "0.0.0.0/0"}} {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:05:03.030040 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-5934f74a-5b41-43bf-8641-54f98457cfad tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] 10.222.0.47 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 233 microversion: 2.1 time: 0.282858 Feb 19 05:05:03.030708 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 359/715] 10.222.0.47 () {60 vars in 1185 bytes} [Fri Feb 19 05:05:02 2021] POST /compute/v2.1/os-security-group-rules => generated 233 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 05:05:03.042112 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-8a81637f-0625-4fed-9c12-1f113234deea tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-TestMinimumBasicScenario-2031567781"}} {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:05:03.042691 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-8a81637f-0625-4fed-9c12-1f113234deea tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] [instance: 0ae0d266-c297-45f1-80fe-0e8f84cc22e6] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:05:03.052654 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-8a81637f-0625-4fed-9c12-1f113234deea tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:05:03.053170 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-8a81637f-0625-4fed-9c12-1f113234deea tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:05:03.054462 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-8a81637f-0625-4fed-9c12-1f113234deea tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:05:03.054967 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-8a81637f-0625-4fed-9c12-1f113234deea tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:05:03.378170 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-58bb62be-609b-443a-b033-adb5906eeee4 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:05:03.379249 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-58bb62be-609b-443a-b033-adb5906eeee4 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] [instance: dcb11872-0660-4e35-8d91-bfe80088844b] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:05:03.413725 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-58bb62be-609b-443a-b033-adb5906eeee4 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:05:03.414298 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-58bb62be-609b-443a-b033-adb5906eeee4 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:05:03.415442 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-58bb62be-609b-443a-b033-adb5906eeee4 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:05:03.416160 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-58bb62be-609b-443a-b033-adb5906eeee4 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:05:03.444496 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.network.security_group_api [None req-8a81637f-0625-4fed-9c12-1f113234deea tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Adding security group e28a7a56-f099-4d02-befc-b2472b7b4da5 to port fa4d6bd7-26d3-4df0-ac31-ae6f1438d6f5 Feb 19 05:05:04.139851 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-58bb62be-609b-443a-b033-adb5906eeee4 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:05:04.150638 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-58bb62be-609b-443a-b033-adb5906eeee4 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:05:04.152959 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-58bb62be-609b-443a-b033-adb5906eeee4 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:05:04.155170 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-58bb62be-609b-443a-b033-adb5906eeee4 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] 10.222.0.47 "GET /compute/v2.1/servers/dcb11872-0660-4e35-8d91-bfe80088844b" status: 200 len: 1406 microversion: 2.20 time: 0.780612 Feb 19 05:05:04.156715 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 360/716] 10.222.0.47 () {60 vars in 1267 bytes} [Fri Feb 19 05:05:03 2021] GET /compute/v2.1/servers/dcb11872-0660-4e35-8d91-bfe80088844b => generated 1406 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 05:05:04.162877 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [req-0807f65b-24cb-464d-907b-4d05479283be req-e055bf19-9920-4329-a0c6-51edd14924b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dcb11872-0660-4e35-8d91-bfe80088844b", "tag": "02a5dd6b-46b0-46bc-b05b-eb9f66823a35"}]} {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:05:04.165082 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 05:05:04.165082 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: warnings.warn(msg) Feb 19 05:05:04.174842 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [req-0807f65b-24cb-464d-907b-4d05479283be req-e055bf19-9920-4329-a0c6-51edd14924b6 service nova] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:05:04.175735 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [req-0807f65b-24cb-464d-907b-4d05479283be req-e055bf19-9920-4329-a0c6-51edd14924b6 service nova] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:05:04.195722 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.compute.server_external_events [req-0807f65b-24cb-464d-907b-4d05479283be req-e055bf19-9920-4329-a0c6-51edd14924b6 service nova] Creating event network-changed:02a5dd6b-46b0-46bc-b05b-eb9f66823a35 for instance dcb11872-0660-4e35-8d91-bfe80088844b on hv-cinder-77642 Feb 19 05:05:04.221462 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [req-0807f65b-24cb-464d-907b-4d05479283be req-e055bf19-9920-4329-a0c6-51edd14924b6 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062931 Feb 19 05:05:04.222118 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 361/717] 10.222.0.47 () {64 vars in 1308 bytes} [Fri Feb 19 05:05:04 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 05:05:04.700148 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-8a81637f-0625-4fed-9c12-1f113234deea tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] 10.222.0.47 "POST /compute/v2.1/servers/0ae0d266-c297-45f1-80fe-0e8f84cc22e6/action" status: 202 len: 0 microversion: 2.1 time: 1.662120 Feb 19 05:05:04.700889 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 357/718] 10.222.0.47 () {60 vars in 1268 bytes} [Fri Feb 19 05:05:03 2021] POST /compute/v2.1/servers/0ae0d266-c297-45f1-80fe-0e8f84cc22e6/action => generated 0 bytes in 1664 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 19 05:05:04.711780 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [req-9aa845f7-43f4-4d80-8094-6636ec2238d5 req-c586d21c-e264-4153-84ea-050ba0d7aaf0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ae0d266-c297-45f1-80fe-0e8f84cc22e6", "tag": "fa4d6bd7-26d3-4df0-ac31-ae6f1438d6f5"}]} {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:05:04.712033 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-21ae0080-4ecd-4a67-8718-6e2501c146aa tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:05:04.713458 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-21ae0080-4ecd-4a67-8718-6e2501c146aa tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] [instance: 0ae0d266-c297-45f1-80fe-0e8f84cc22e6] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:05:04.715135 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 05:05:04.715135 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: warnings.warn(msg) Feb 19 05:05:04.726066 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [req-9aa845f7-43f4-4d80-8094-6636ec2238d5 req-c586d21c-e264-4153-84ea-050ba0d7aaf0 service nova] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:05:04.726772 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [req-9aa845f7-43f4-4d80-8094-6636ec2238d5 req-c586d21c-e264-4153-84ea-050ba0d7aaf0 service nova] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:05:04.729251 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-21ae0080-4ecd-4a67-8718-6e2501c146aa tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:05:04.729757 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-21ae0080-4ecd-4a67-8718-6e2501c146aa tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:05:04.730775 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-21ae0080-4ecd-4a67-8718-6e2501c146aa tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:05:04.731271 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-21ae0080-4ecd-4a67-8718-6e2501c146aa tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:05:04.753735 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.compute.server_external_events [req-9aa845f7-43f4-4d80-8094-6636ec2238d5 req-c586d21c-e264-4153-84ea-050ba0d7aaf0 service nova] Creating event network-changed:fa4d6bd7-26d3-4df0-ac31-ae6f1438d6f5 for instance 0ae0d266-c297-45f1-80fe-0e8f84cc22e6 on hv-cinder-77642 Feb 19 05:05:04.760560 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [req-9aa845f7-43f4-4d80-8094-6636ec2238d5 req-c586d21c-e264-4153-84ea-050ba0d7aaf0 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052798 Feb 19 05:05:04.761469 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 358/719] 10.222.0.47 () {64 vars in 1308 bytes} [Fri Feb 19 05:05:04 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 19 05:05:05.112674 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-21ae0080-4ecd-4a67-8718-6e2501c146aa tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5df26a2a7e854705800096f12d30c8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3309eb07e18a46a2a0bcbde1f9e46dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:05:05.125067 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-21ae0080-4ecd-4a67-8718-6e2501c146aa tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] 10.222.0.47 "GET /compute/v2.1/servers/0ae0d266-c297-45f1-80fe-0e8f84cc22e6" status: 200 len: 1768 microversion: 2.1 time: 0.418328 Feb 19 05:05:05.125954 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 362/720] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:05:04 2021] GET /compute/v2.1/servers/0ae0d266-c297-45f1-80fe-0e8f84cc22e6 => generated 1768 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:05:05.178904 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-bba18aa6-b498-44b5-bdbd-654fec7da95c tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:05:05.181944 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-bba18aa6-b498-44b5-bdbd-654fec7da95c tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] [instance: dcb11872-0660-4e35-8d91-bfe80088844b] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:05:05.190935 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-bba18aa6-b498-44b5-bdbd-654fec7da95c tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:05:05.191569 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-bba18aa6-b498-44b5-bdbd-654fec7da95c tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:05:05.192322 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-bba18aa6-b498-44b5-bdbd-654fec7da95c tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:05:05.192822 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-bba18aa6-b498-44b5-bdbd-654fec7da95c tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:05:05.471281 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-bba18aa6-b498-44b5-bdbd-654fec7da95c tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:05:05.491489 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-bba18aa6-b498-44b5-bdbd-654fec7da95c tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:05:05.495214 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-bba18aa6-b498-44b5-bdbd-654fec7da95c tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:05:05.497663 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-bba18aa6-b498-44b5-bdbd-654fec7da95c tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] 10.222.0.47 "GET /compute/v2.1/servers/dcb11872-0660-4e35-8d91-bfe80088844b" status: 200 len: 1406 microversion: 2.20 time: 0.324262 Feb 19 05:05:05.498890 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 359/721] 10.222.0.47 () {60 vars in 1267 bytes} [Fri Feb 19 05:05:05 2021] GET /compute/v2.1/servers/dcb11872-0660-4e35-8d91-bfe80088844b => generated 1406 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 19 05:05:06.518756 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-18ea772f-beea-4438-9080-0ad9a97942a5 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:05:06.519571 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-18ea772f-beea-4438-9080-0ad9a97942a5 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] [instance: dcb11872-0660-4e35-8d91-bfe80088844b] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:05:06.528044 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-18ea772f-beea-4438-9080-0ad9a97942a5 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:05:06.528409 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-18ea772f-beea-4438-9080-0ad9a97942a5 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:05:06.529954 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-18ea772f-beea-4438-9080-0ad9a97942a5 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:05:06.530464 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-18ea772f-beea-4438-9080-0ad9a97942a5 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:05:06.805946 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-18ea772f-beea-4438-9080-0ad9a97942a5 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:05:06.816787 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-18ea772f-beea-4438-9080-0ad9a97942a5 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:05:06.818430 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-18ea772f-beea-4438-9080-0ad9a97942a5 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:05:06.819875 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-18ea772f-beea-4438-9080-0ad9a97942a5 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] 10.222.0.47 "GET /compute/v2.1/servers/dcb11872-0660-4e35-8d91-bfe80088844b" status: 200 len: 1406 microversion: 2.20 time: 0.305094 Feb 19 05:05:06.820409 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 363/722] 10.222.0.47 () {60 vars in 1267 bytes} [Fri Feb 19 05:05:06 2021] GET /compute/v2.1/servers/dcb11872-0660-4e35-8d91-bfe80088844b => generated 1406 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 05:05:07.827517 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-beb256dd-ebe0-4f9a-8f95-5389ea0006b3 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:05:07.828194 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-beb256dd-ebe0-4f9a-8f95-5389ea0006b3 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] [instance: be65ea57-bc8d-4bce-80c3-33d8b6007ed1] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:05:07.841327 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-3ec2aa83-2134-4f95-b1f0-85132fca1f07 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:05:07.842575 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-3ec2aa83-2134-4f95-b1f0-85132fca1f07 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] [instance: dcb11872-0660-4e35-8d91-bfe80088844b] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:05:07.860142 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-3ec2aa83-2134-4f95-b1f0-85132fca1f07 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:05:07.860907 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-3ec2aa83-2134-4f95-b1f0-85132fca1f07 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:05:07.861939 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-3ec2aa83-2134-4f95-b1f0-85132fca1f07 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:05:07.862584 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-3ec2aa83-2134-4f95-b1f0-85132fca1f07 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:05:07.868275 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-beb256dd-ebe0-4f9a-8f95-5389ea0006b3 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:05:07.868805 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-beb256dd-ebe0-4f9a-8f95-5389ea0006b3 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:05:07.869695 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-beb256dd-ebe0-4f9a-8f95-5389ea0006b3 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:05:07.870193 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-beb256dd-ebe0-4f9a-8f95-5389ea0006b3 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:05:08.001903 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-beb256dd-ebe0-4f9a-8f95-5389ea0006b3 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] [instance: be65ea57-bc8d-4bce-80c3-33d8b6007ed1] Going to try to terminate instance {{(pid=98153) delete /opt/stack/nova/nova/compute/api.py:2540}} Feb 19 05:05:08.221097 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-beb256dd-ebe0-4f9a-8f95-5389ea0006b3 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] 10.222.0.47 "DELETE /compute/v2.1/servers/be65ea57-bc8d-4bce-80c3-33d8b6007ed1" status: 204 len: 0 microversion: 2.1 time: 0.401131 Feb 19 05:05:08.222055 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 360/723] 10.222.0.47 () {58 vars in 1229 bytes} [Fri Feb 19 05:05:07 2021] DELETE /compute/v2.1/servers/be65ea57-bc8d-4bce-80c3-33d8b6007ed1 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 19 05:05:08.231846 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-c28430d6-9594-4405-b17c-f26204f9a583 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:05:08.242720 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-c28430d6-9594-4405-b17c-f26204f9a583 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] [instance: be65ea57-bc8d-4bce-80c3-33d8b6007ed1] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:05:08.261964 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-c28430d6-9594-4405-b17c-f26204f9a583 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:05:08.268633 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-c28430d6-9594-4405-b17c-f26204f9a583 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:05:08.269715 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-c28430d6-9594-4405-b17c-f26204f9a583 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:05:08.270367 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-c28430d6-9594-4405-b17c-f26204f9a583 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:05:08.722227 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-3ec2aa83-2134-4f95-b1f0-85132fca1f07 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:05:08.742093 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-3ec2aa83-2134-4f95-b1f0-85132fca1f07 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:05:08.744837 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-3ec2aa83-2134-4f95-b1f0-85132fca1f07 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:05:08.746843 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-3ec2aa83-2134-4f95-b1f0-85132fca1f07 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] 10.222.0.47 "GET /compute/v2.1/servers/dcb11872-0660-4e35-8d91-bfe80088844b" status: 200 len: 1406 microversion: 2.20 time: 0.910108 Feb 19 05:05:08.749007 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 364/724] 10.222.0.47 () {60 vars in 1267 bytes} [Fri Feb 19 05:05:07 2021] GET /compute/v2.1/servers/dcb11872-0660-4e35-8d91-bfe80088844b => generated 1406 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 05:05:08.794217 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-c28430d6-9594-4405-b17c-f26204f9a583 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3274478c0a421895f43618dc827ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50941a0cab243e9a320ff22a7648de6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:05:08.804855 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-c28430d6-9594-4405-b17c-f26204f9a583 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] 10.222.0.47 "GET /compute/v2.1/servers/be65ea57-bc8d-4bce-80c3-33d8b6007ed1" status: 200 len: 1671 microversion: 2.1 time: 0.577657 Feb 19 05:05:08.805905 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 361/725] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:05:08 2021] GET /compute/v2.1/servers/be65ea57-bc8d-4bce-80c3-33d8b6007ed1 => generated 1671 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 05:05:09.767493 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-7b8bb6e5-13f1-4043-bb1e-2836a876804a tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:05:09.768227 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-7b8bb6e5-13f1-4043-bb1e-2836a876804a tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] [instance: dcb11872-0660-4e35-8d91-bfe80088844b] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:05:09.778102 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-7b8bb6e5-13f1-4043-bb1e-2836a876804a tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:05:09.778666 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-7b8bb6e5-13f1-4043-bb1e-2836a876804a tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:05:09.780682 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-7b8bb6e5-13f1-4043-bb1e-2836a876804a tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:05:09.781181 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-7b8bb6e5-13f1-4043-bb1e-2836a876804a tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:05:09.825736 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-9f85aa31-9d1e-4c0d-aceb-204cb29ed1fb tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:05:09.826784 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-9f85aa31-9d1e-4c0d-aceb-204cb29ed1fb tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] [instance: be65ea57-bc8d-4bce-80c3-33d8b6007ed1] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:05:09.835283 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-9f85aa31-9d1e-4c0d-aceb-204cb29ed1fb tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:05:09.835839 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-9f85aa31-9d1e-4c0d-aceb-204cb29ed1fb tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:05:09.836679 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-9f85aa31-9d1e-4c0d-aceb-204cb29ed1fb tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:05:09.837173 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-9f85aa31-9d1e-4c0d-aceb-204cb29ed1fb tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:05:10.101449 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-7b8bb6e5-13f1-4043-bb1e-2836a876804a tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:05:10.115246 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-7b8bb6e5-13f1-4043-bb1e-2836a876804a tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:05:10.117238 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-7b8bb6e5-13f1-4043-bb1e-2836a876804a tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:05:10.118618 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-7b8bb6e5-13f1-4043-bb1e-2836a876804a tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] 10.222.0.47 "GET /compute/v2.1/servers/dcb11872-0660-4e35-8d91-bfe80088844b" status: 200 len: 1406 microversion: 2.20 time: 0.355965 Feb 19 05:05:10.119224 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 365/726] 10.222.0.47 () {60 vars in 1267 bytes} [Fri Feb 19 05:05:09 2021] GET /compute/v2.1/servers/dcb11872-0660-4e35-8d91-bfe80088844b => generated 1406 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 05:05:10.126299 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-9f85aa31-9d1e-4c0d-aceb-204cb29ed1fb tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3274478c0a421895f43618dc827ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50941a0cab243e9a320ff22a7648de6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:05:10.135506 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-9f85aa31-9d1e-4c0d-aceb-204cb29ed1fb tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] 10.222.0.47 "GET /compute/v2.1/servers/be65ea57-bc8d-4bce-80c3-33d8b6007ed1" status: 200 len: 1671 microversion: 2.1 time: 0.313789 Feb 19 05:05:10.136429 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 362/727] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:05:09 2021] GET /compute/v2.1/servers/be65ea57-bc8d-4bce-80c3-33d8b6007ed1 => generated 1671 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 05:05:11.138737 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-85cde07f-9815-4df9-915d-7602993a5cdf tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:05:11.139433 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-85cde07f-9815-4df9-915d-7602993a5cdf tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] [instance: dcb11872-0660-4e35-8d91-bfe80088844b] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:05:11.148381 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-85cde07f-9815-4df9-915d-7602993a5cdf tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:05:11.148893 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-85cde07f-9815-4df9-915d-7602993a5cdf tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:05:11.149734 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-85cde07f-9815-4df9-915d-7602993a5cdf tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:05:11.150226 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-85cde07f-9815-4df9-915d-7602993a5cdf tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:05:11.156849 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-8b9f6107-7d98-4036-aaca-4885599a3a59 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:05:11.157575 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-8b9f6107-7d98-4036-aaca-4885599a3a59 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] [instance: be65ea57-bc8d-4bce-80c3-33d8b6007ed1] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:05:11.166079 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-8b9f6107-7d98-4036-aaca-4885599a3a59 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:05:11.166586 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-8b9f6107-7d98-4036-aaca-4885599a3a59 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:05:11.167478 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-8b9f6107-7d98-4036-aaca-4885599a3a59 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:05:11.167973 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-8b9f6107-7d98-4036-aaca-4885599a3a59 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:05:11.478053 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-85cde07f-9815-4df9-915d-7602993a5cdf tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:05:11.488455 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-8b9f6107-7d98-4036-aaca-4885599a3a59 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3274478c0a421895f43618dc827ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50941a0cab243e9a320ff22a7648de6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:05:11.488748 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-85cde07f-9815-4df9-915d-7602993a5cdf tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:05:11.490456 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-85cde07f-9815-4df9-915d-7602993a5cdf tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:05:11.491795 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-85cde07f-9815-4df9-915d-7602993a5cdf tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] 10.222.0.47 "GET /compute/v2.1/servers/dcb11872-0660-4e35-8d91-bfe80088844b" status: 200 len: 1406 microversion: 2.20 time: 0.357681 Feb 19 05:05:11.492507 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 366/728] 10.222.0.47 () {60 vars in 1267 bytes} [Fri Feb 19 05:05:11 2021] GET /compute/v2.1/servers/dcb11872-0660-4e35-8d91-bfe80088844b => generated 1406 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 05:05:11.498442 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-8b9f6107-7d98-4036-aaca-4885599a3a59 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] 10.222.0.47 "GET /compute/v2.1/servers/be65ea57-bc8d-4bce-80c3-33d8b6007ed1" status: 200 len: 1671 microversion: 2.1 time: 0.345970 Feb 19 05:05:11.499624 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 363/729] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:05:11 2021] GET /compute/v2.1/servers/be65ea57-bc8d-4bce-80c3-33d8b6007ed1 => generated 1671 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:05:12.513670 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-37358fd0-dd03-4cb3-8a91-0a02fe8f811e tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:05:12.522384 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-053ac8ea-c71c-453d-aa4a-f4d4ece16e18 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:05:12.523125 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-053ac8ea-c71c-453d-aa4a-f4d4ece16e18 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] [instance: be65ea57-bc8d-4bce-80c3-33d8b6007ed1] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:05:12.528244 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-37358fd0-dd03-4cb3-8a91-0a02fe8f811e tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] [instance: dcb11872-0660-4e35-8d91-bfe80088844b] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:05:12.532514 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-053ac8ea-c71c-453d-aa4a-f4d4ece16e18 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:05:12.533221 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-053ac8ea-c71c-453d-aa4a-f4d4ece16e18 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:05:12.534393 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-053ac8ea-c71c-453d-aa4a-f4d4ece16e18 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:05:12.534979 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-053ac8ea-c71c-453d-aa4a-f4d4ece16e18 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:05:12.537104 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-37358fd0-dd03-4cb3-8a91-0a02fe8f811e tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:05:12.537607 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-37358fd0-dd03-4cb3-8a91-0a02fe8f811e tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:05:12.538474 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-37358fd0-dd03-4cb3-8a91-0a02fe8f811e tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:05:12.538966 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-37358fd0-dd03-4cb3-8a91-0a02fe8f811e tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:05:12.892580 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-053ac8ea-c71c-453d-aa4a-f4d4ece16e18 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3274478c0a421895f43618dc827ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50941a0cab243e9a320ff22a7648de6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:05:12.895976 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-37358fd0-dd03-4cb3-8a91-0a02fe8f811e tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:05:12.902216 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-053ac8ea-c71c-453d-aa4a-f4d4ece16e18 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] 10.222.0.47 "GET /compute/v2.1/servers/be65ea57-bc8d-4bce-80c3-33d8b6007ed1" status: 200 len: 1671 microversion: 2.1 time: 0.386426 Feb 19 05:05:12.903021 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 364/730] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:05:12 2021] GET /compute/v2.1/servers/be65ea57-bc8d-4bce-80c3-33d8b6007ed1 => generated 1671 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:05:12.907076 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-37358fd0-dd03-4cb3-8a91-0a02fe8f811e tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:05:12.908806 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-37358fd0-dd03-4cb3-8a91-0a02fe8f811e tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:05:12.910045 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-37358fd0-dd03-4cb3-8a91-0a02fe8f811e tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] 10.222.0.47 "GET /compute/v2.1/servers/dcb11872-0660-4e35-8d91-bfe80088844b" status: 200 len: 1406 microversion: 2.20 time: 0.402487 Feb 19 05:05:12.910688 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 367/731] 10.222.0.47 () {60 vars in 1267 bytes} [Fri Feb 19 05:05:12 2021] GET /compute/v2.1/servers/dcb11872-0660-4e35-8d91-bfe80088844b => generated 1406 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 05:05:13.373718 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [req-e66272b8-f403-4051-be59-3edffa1d8047 req-ef4cd72a-1088-410d-a0de-0f398a533867 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dcb11872-0660-4e35-8d91-bfe80088844b", "name": "network-vif-plugged", "status": "completed", "tag": "02a5dd6b-46b0-46bc-b05b-eb9f66823a35"}]} {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:05:13.376808 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 05:05:13.376808 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: warnings.warn(msg) Feb 19 05:05:13.386729 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [req-e66272b8-f403-4051-be59-3edffa1d8047 req-ef4cd72a-1088-410d-a0de-0f398a533867 service nova] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:05:13.387251 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [req-e66272b8-f403-4051-be59-3edffa1d8047 req-ef4cd72a-1088-410d-a0de-0f398a533867 service nova] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:05:13.409810 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.compute.server_external_events [req-e66272b8-f403-4051-be59-3edffa1d8047 req-ef4cd72a-1088-410d-a0de-0f398a533867 service nova] Creating event network-vif-plugged:02a5dd6b-46b0-46bc-b05b-eb9f66823a35 for instance dcb11872-0660-4e35-8d91-bfe80088844b on hv-cinder-77642 Feb 19 05:05:13.414851 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [req-e66272b8-f403-4051-be59-3edffa1d8047 req-ef4cd72a-1088-410d-a0de-0f398a533867 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047106 Feb 19 05:05:13.415558 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 365/732] 10.222.0.47 () {64 vars in 1308 bytes} [Fri Feb 19 05:05:13 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 05:05:13.932556 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-e79f662a-0ccc-4cf7-a578-cd89114849b7 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:05:13.933534 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-e79f662a-0ccc-4cf7-a578-cd89114849b7 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] [instance: dcb11872-0660-4e35-8d91-bfe80088844b] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:05:13.934677 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-a50587b1-6a51-4aaf-82b3-41be7be30f1c tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:05:13.938650 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-a50587b1-6a51-4aaf-82b3-41be7be30f1c tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] [instance: be65ea57-bc8d-4bce-80c3-33d8b6007ed1] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:05:13.950675 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-e79f662a-0ccc-4cf7-a578-cd89114849b7 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:05:13.951633 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-e79f662a-0ccc-4cf7-a578-cd89114849b7 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:05:13.956964 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-e79f662a-0ccc-4cf7-a578-cd89114849b7 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:05:13.957687 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-e79f662a-0ccc-4cf7-a578-cd89114849b7 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:05:13.973609 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-a50587b1-6a51-4aaf-82b3-41be7be30f1c tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:05:13.974394 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-a50587b1-6a51-4aaf-82b3-41be7be30f1c tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:05:13.988896 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-a50587b1-6a51-4aaf-82b3-41be7be30f1c tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:05:13.989737 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-a50587b1-6a51-4aaf-82b3-41be7be30f1c tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:05:14.489528 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-a50587b1-6a51-4aaf-82b3-41be7be30f1c tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3274478c0a421895f43618dc827ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50941a0cab243e9a320ff22a7648de6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:05:14.501708 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-a50587b1-6a51-4aaf-82b3-41be7be30f1c tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] 10.222.0.47 "GET /compute/v2.1/servers/be65ea57-bc8d-4bce-80c3-33d8b6007ed1" status: 200 len: 1671 microversion: 2.1 time: 0.582828 Feb 19 05:05:14.511817 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 368/733] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:05:13 2021] GET /compute/v2.1/servers/be65ea57-bc8d-4bce-80c3-33d8b6007ed1 => generated 1671 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:05:14.657163 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-e79f662a-0ccc-4cf7-a578-cd89114849b7 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:05:14.669281 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-e79f662a-0ccc-4cf7-a578-cd89114849b7 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:05:14.671626 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-e79f662a-0ccc-4cf7-a578-cd89114849b7 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:05:14.673053 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-e79f662a-0ccc-4cf7-a578-cd89114849b7 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] 10.222.0.47 "GET /compute/v2.1/servers/dcb11872-0660-4e35-8d91-bfe80088844b" status: 200 len: 1406 microversion: 2.20 time: 0.745751 Feb 19 05:05:14.685926 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 366/734] 10.222.0.47 () {60 vars in 1267 bytes} [Fri Feb 19 05:05:13 2021] GET /compute/v2.1/servers/dcb11872-0660-4e35-8d91-bfe80088844b => generated 1406 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 05:05:15.432247 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [req-9da34357-e974-4d63-93ba-aacff0cf02d9 req-1a1afb33-9e71-4e2e-8ce6-8f13d365c7e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be65ea57-bc8d-4bce-80c3-33d8b6007ed1", "name": "network-vif-unplugged", "status": "completed", "tag": "d8d91e89-f645-4300-857f-325550442803"}]} {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:05:15.434218 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 05:05:15.434218 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: warnings.warn(msg) Feb 19 05:05:15.444327 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [req-9da34357-e974-4d63-93ba-aacff0cf02d9 req-1a1afb33-9e71-4e2e-8ce6-8f13d365c7e1 service nova] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:05:15.445342 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [req-9da34357-e974-4d63-93ba-aacff0cf02d9 req-1a1afb33-9e71-4e2e-8ce6-8f13d365c7e1 service nova] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:05:15.466738 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.compute.server_external_events [req-9da34357-e974-4d63-93ba-aacff0cf02d9 req-1a1afb33-9e71-4e2e-8ce6-8f13d365c7e1 service nova] Creating event network-vif-unplugged:d8d91e89-f645-4300-857f-325550442803 for instance be65ea57-bc8d-4bce-80c3-33d8b6007ed1 on hv-cinder-77642 Feb 19 05:05:15.474407 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [req-9da34357-e974-4d63-93ba-aacff0cf02d9 req-1a1afb33-9e71-4e2e-8ce6-8f13d365c7e1 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046946 Feb 19 05:05:15.475080 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 369/735] 10.222.0.47 () {64 vars in 1308 bytes} [Fri Feb 19 05:05:15 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 05:05:15.536567 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-66444d6a-704d-45aa-b29e-4f38083998f5 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:05:15.537248 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-66444d6a-704d-45aa-b29e-4f38083998f5 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] [instance: be65ea57-bc8d-4bce-80c3-33d8b6007ed1] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:05:15.546583 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-66444d6a-704d-45aa-b29e-4f38083998f5 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:05:15.547864 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-66444d6a-704d-45aa-b29e-4f38083998f5 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:05:15.548736 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-66444d6a-704d-45aa-b29e-4f38083998f5 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:05:15.549234 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-66444d6a-704d-45aa-b29e-4f38083998f5 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:05:15.694267 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-6258be2f-13bd-4c01-bd82-3056f2c62e5a tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:05:15.695058 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-6258be2f-13bd-4c01-bd82-3056f2c62e5a tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] [instance: dcb11872-0660-4e35-8d91-bfe80088844b] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:05:15.704617 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-6258be2f-13bd-4c01-bd82-3056f2c62e5a tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:05:15.705130 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-6258be2f-13bd-4c01-bd82-3056f2c62e5a tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:05:15.705986 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-6258be2f-13bd-4c01-bd82-3056f2c62e5a tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:05:15.706628 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-6258be2f-13bd-4c01-bd82-3056f2c62e5a tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:05:15.792186 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-66444d6a-704d-45aa-b29e-4f38083998f5 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3274478c0a421895f43618dc827ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50941a0cab243e9a320ff22a7648de6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:05:15.801625 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-66444d6a-704d-45aa-b29e-4f38083998f5 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] 10.222.0.47 "GET /compute/v2.1/servers/be65ea57-bc8d-4bce-80c3-33d8b6007ed1" status: 200 len: 1671 microversion: 2.1 time: 0.269007 Feb 19 05:05:15.802521 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 367/736] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:05:15 2021] GET /compute/v2.1/servers/be65ea57-bc8d-4bce-80c3-33d8b6007ed1 => generated 1671 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:05:16.051054 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-6258be2f-13bd-4c01-bd82-3056f2c62e5a tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:05:16.065470 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-6258be2f-13bd-4c01-bd82-3056f2c62e5a tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:05:16.071031 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-6258be2f-13bd-4c01-bd82-3056f2c62e5a tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:05:16.074943 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-6258be2f-13bd-4c01-bd82-3056f2c62e5a tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] 10.222.0.47 "GET /compute/v2.1/servers/dcb11872-0660-4e35-8d91-bfe80088844b" status: 200 len: 1599 microversion: 2.20 time: 0.385410 Feb 19 05:05:16.079666 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 370/737] 10.222.0.47 () {60 vars in 1267 bytes} [Fri Feb 19 05:05:15 2021] GET /compute/v2.1/servers/dcb11872-0660-4e35-8d91-bfe80088844b => generated 1599 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 19 05:05:16.101653 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-b11d93c2-e9bd-464c-8171-dcaed6f7c3e8 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:05:16.103157 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-b11d93c2-e9bd-464c-8171-dcaed6f7c3e8 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] [instance: dcb11872-0660-4e35-8d91-bfe80088844b] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:05:16.114306 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-b11d93c2-e9bd-464c-8171-dcaed6f7c3e8 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:05:16.114906 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-b11d93c2-e9bd-464c-8171-dcaed6f7c3e8 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:05:16.116386 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-b11d93c2-e9bd-464c-8171-dcaed6f7c3e8 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:05:16.117142 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-b11d93c2-e9bd-464c-8171-dcaed6f7c3e8 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:05:16.344317 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-b11d93c2-e9bd-464c-8171-dcaed6f7c3e8 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] 10.222.0.47 "GET /compute/v2.1/servers/dcb11872-0660-4e35-8d91-bfe80088844b/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.245867 Feb 19 05:05:16.344938 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 368/738] 10.222.0.47 () {60 vars in 1306 bytes} [Fri Feb 19 05:05:16 2021] GET /compute/v2.1/servers/dcb11872-0660-4e35-8d91-bfe80088844b/os-interface => generated 285 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 19 05:05:16.824298 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-9612d1cb-85d7-4b0b-b0d2-171892645e68 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:05:16.824985 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-9612d1cb-85d7-4b0b-b0d2-171892645e68 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] [instance: be65ea57-bc8d-4bce-80c3-33d8b6007ed1] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:05:16.835425 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-9612d1cb-85d7-4b0b-b0d2-171892645e68 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:05:16.845303 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-9612d1cb-85d7-4b0b-b0d2-171892645e68 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:05:16.846433 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-9612d1cb-85d7-4b0b-b0d2-171892645e68 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:05:16.846934 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-9612d1cb-85d7-4b0b-b0d2-171892645e68 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:05:17.080880 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-9612d1cb-85d7-4b0b-b0d2-171892645e68 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3274478c0a421895f43618dc827ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50941a0cab243e9a320ff22a7648de6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:05:17.095294 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-9612d1cb-85d7-4b0b-b0d2-171892645e68 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] 10.222.0.47 "GET /compute/v2.1/servers/be65ea57-bc8d-4bce-80c3-33d8b6007ed1" status: 200 len: 1604 microversion: 2.1 time: 0.276067 Feb 19 05:05:17.096388 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 371/739] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:05:16 2021] GET /compute/v2.1/servers/be65ea57-bc8d-4bce-80c3-33d8b6007ed1 => generated 1604 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:05:17.695209 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [req-7ae925af-f8c5-463e-a28f-5326a9b440b8 req-49e57ee8-e1e0-442c-b40e-7e3aa8fb4009 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be65ea57-bc8d-4bce-80c3-33d8b6007ed1", "name": "network-vif-deleted", "tag": "d8d91e89-f645-4300-857f-325550442803"}]} {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:05:17.697983 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 05:05:17.697983 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: warnings.warn(msg) Feb 19 05:05:17.711581 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [req-7ae925af-f8c5-463e-a28f-5326a9b440b8 req-49e57ee8-e1e0-442c-b40e-7e3aa8fb4009 service nova] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:05:17.712435 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [req-7ae925af-f8c5-463e-a28f-5326a9b440b8 req-49e57ee8-e1e0-442c-b40e-7e3aa8fb4009 service nova] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:05:17.739669 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.compute.server_external_events [req-7ae925af-f8c5-463e-a28f-5326a9b440b8 req-49e57ee8-e1e0-442c-b40e-7e3aa8fb4009 service nova] Creating event network-vif-deleted:d8d91e89-f645-4300-857f-325550442803 for instance be65ea57-bc8d-4bce-80c3-33d8b6007ed1 on hv-cinder-77642 Feb 19 05:05:17.746644 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [req-7ae925af-f8c5-463e-a28f-5326a9b440b8 req-49e57ee8-e1e0-442c-b40e-7e3aa8fb4009 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.280021 Feb 19 05:05:17.747788 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 369/740] 10.222.0.47 () {64 vars in 1308 bytes} [Fri Feb 19 05:05:17 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 05:05:18.118200 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-efc67409-20d1-4cba-8e7b-3a42a3ec9ba4 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:05:18.118980 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-efc67409-20d1-4cba-8e7b-3a42a3ec9ba4 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] [instance: be65ea57-bc8d-4bce-80c3-33d8b6007ed1] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:05:18.131058 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-efc67409-20d1-4cba-8e7b-3a42a3ec9ba4 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:05:18.131982 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-efc67409-20d1-4cba-8e7b-3a42a3ec9ba4 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:05:18.133314 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-efc67409-20d1-4cba-8e7b-3a42a3ec9ba4 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:05:18.134139 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-efc67409-20d1-4cba-8e7b-3a42a3ec9ba4 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:05:18.343542 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-efc67409-20d1-4cba-8e7b-3a42a3ec9ba4 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3274478c0a421895f43618dc827ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50941a0cab243e9a320ff22a7648de6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:05:18.355148 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-efc67409-20d1-4cba-8e7b-3a42a3ec9ba4 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] 10.222.0.47 "GET /compute/v2.1/servers/be65ea57-bc8d-4bce-80c3-33d8b6007ed1" status: 200 len: 1604 microversion: 2.1 time: 0.243122 Feb 19 05:05:18.367254 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 372/741] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:05:18 2021] GET /compute/v2.1/servers/be65ea57-bc8d-4bce-80c3-33d8b6007ed1 => generated 1604 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:05:18.748710 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [req-9cf6c586-50c6-441d-a21f-75d45540c88b req-f7792f4b-9969-4090-865f-74f4d076b5d8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dcb11872-0660-4e35-8d91-bfe80088844b", "tag": "02a5dd6b-46b0-46bc-b05b-eb9f66823a35"}]} {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:05:18.753291 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 05:05:18.753291 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: warnings.warn(msg) Feb 19 05:05:18.754784 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-396c1647-d4de-48ac-a2f1-16e606ad27dd tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:05:18.756315 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-396c1647-d4de-48ac-a2f1-16e606ad27dd tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] [instance: dcb11872-0660-4e35-8d91-bfe80088844b] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:05:18.774764 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [req-9cf6c586-50c6-441d-a21f-75d45540c88b req-f7792f4b-9969-4090-865f-74f4d076b5d8 service nova] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:05:18.777665 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-396c1647-d4de-48ac-a2f1-16e606ad27dd tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:05:18.778281 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-396c1647-d4de-48ac-a2f1-16e606ad27dd tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:05:18.779183 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [req-9cf6c586-50c6-441d-a21f-75d45540c88b req-f7792f4b-9969-4090-865f-74f4d076b5d8 service nova] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:05:18.780382 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-396c1647-d4de-48ac-a2f1-16e606ad27dd tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:05:18.781612 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-396c1647-d4de-48ac-a2f1-16e606ad27dd tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:05:18.820673 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.compute.server_external_events [req-9cf6c586-50c6-441d-a21f-75d45540c88b req-f7792f4b-9969-4090-865f-74f4d076b5d8 service nova] Creating event network-changed:02a5dd6b-46b0-46bc-b05b-eb9f66823a35 for instance dcb11872-0660-4e35-8d91-bfe80088844b on hv-cinder-77642 Feb 19 05:05:18.835486 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [req-9cf6c586-50c6-441d-a21f-75d45540c88b req-f7792f4b-9969-4090-865f-74f4d076b5d8 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090489 Feb 19 05:05:18.836805 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 373/742] 10.222.0.47 () {64 vars in 1308 bytes} [Fri Feb 19 05:05:18 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 05:05:19.330455 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-437aa7d5-f224-40d3-a61e-d1517c2899fe tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:05:19.331773 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-437aa7d5-f224-40d3-a61e-d1517c2899fe tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] [instance: 0ae0d266-c297-45f1-80fe-0e8f84cc22e6] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:05:19.361368 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-437aa7d5-f224-40d3-a61e-d1517c2899fe tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:05:19.362921 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-437aa7d5-f224-40d3-a61e-d1517c2899fe tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:05:19.373619 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-437aa7d5-f224-40d3-a61e-d1517c2899fe tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:05:19.373897 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-437aa7d5-f224-40d3-a61e-d1517c2899fe tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:05:19.643878 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-437aa7d5-f224-40d3-a61e-d1517c2899fe tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] 10.222.0.47 "POST /compute/v2.1/servers/0ae0d266-c297-45f1-80fe-0e8f84cc22e6/action" status: 202 len: 0 microversion: 2.1 time: 0.319338 Feb 19 05:05:19.644718 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 374/743] 10.222.0.47 () {60 vars in 1268 bytes} [Fri Feb 19 05:05:19 2021] POST /compute/v2.1/servers/0ae0d266-c297-45f1-80fe-0e8f84cc22e6/action => generated 0 bytes in 322 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 19 05:05:19.652237 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-4d874cb1-b183-4999-81b6-e7c63e0b8338 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:05:19.653162 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-4d874cb1-b183-4999-81b6-e7c63e0b8338 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] [instance: be65ea57-bc8d-4bce-80c3-33d8b6007ed1] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:05:19.662768 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-4d874cb1-b183-4999-81b6-e7c63e0b8338 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:05:19.663255 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-4d874cb1-b183-4999-81b6-e7c63e0b8338 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:05:19.664220 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-4d874cb1-b183-4999-81b6-e7c63e0b8338 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:05:19.667904 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-4d874cb1-b183-4999-81b6-e7c63e0b8338 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:05:19.916092 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-4d874cb1-b183-4999-81b6-e7c63e0b8338 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3274478c0a421895f43618dc827ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50941a0cab243e9a320ff22a7648de6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:05:19.933777 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-4d874cb1-b183-4999-81b6-e7c63e0b8338 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] 10.222.0.47 "GET /compute/v2.1/servers/be65ea57-bc8d-4bce-80c3-33d8b6007ed1" status: 200 len: 1320 microversion: 2.1 time: 0.287136 Feb 19 05:05:19.948914 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 375/744] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:05:19 2021] GET /compute/v2.1/servers/be65ea57-bc8d-4bce-80c3-33d8b6007ed1 => generated 1320 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:05:19.978222 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-00368ebd-eef7-46d1-81b3-79d247dfb1d1 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:05:19.979728 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-00368ebd-eef7-46d1-81b3-79d247dfb1d1 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] [instance: 0ae0d266-c297-45f1-80fe-0e8f84cc22e6] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:05:19.994603 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-00368ebd-eef7-46d1-81b3-79d247dfb1d1 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:05:19.995114 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-00368ebd-eef7-46d1-81b3-79d247dfb1d1 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:05:19.996669 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-00368ebd-eef7-46d1-81b3-79d247dfb1d1 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:05:19.997170 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-00368ebd-eef7-46d1-81b3-79d247dfb1d1 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:05:20.360431 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-00368ebd-eef7-46d1-81b3-79d247dfb1d1 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5df26a2a7e854705800096f12d30c8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3309eb07e18a46a2a0bcbde1f9e46dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:05:20.395409 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-00368ebd-eef7-46d1-81b3-79d247dfb1d1 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] 10.222.0.47 "GET /compute/v2.1/servers/0ae0d266-c297-45f1-80fe-0e8f84cc22e6" status: 200 len: 1760 microversion: 2.1 time: 0.444777 Feb 19 05:05:20.396798 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 376/745] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:05:19 2021] GET /compute/v2.1/servers/0ae0d266-c297-45f1-80fe-0e8f84cc22e6 => generated 1760 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:05:20.496647 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-396c1647-d4de-48ac-a2f1-16e606ad27dd tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] 10.222.0.47 "POST /compute/v2.1/servers/dcb11872-0660-4e35-8d91-bfe80088844b/action" status: 200 len: 14 microversion: 2.20 time: 1.748680 Feb 19 05:05:20.504122 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 370/746] 10.222.0.47 () {62 vars in 1309 bytes} [Fri Feb 19 05:05:18 2021] POST /compute/v2.1/servers/dcb11872-0660-4e35-8d91-bfe80088844b/action => generated 14 bytes in 1765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:05:20.953614 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-55d20b29-2fd6-44ff-9fd1-302f5bf4ead8 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:05:20.954626 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-55d20b29-2fd6-44ff-9fd1-302f5bf4ead8 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] [instance: be65ea57-bc8d-4bce-80c3-33d8b6007ed1] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:05:20.986496 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-55d20b29-2fd6-44ff-9fd1-302f5bf4ead8 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:05:20.991923 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-55d20b29-2fd6-44ff-9fd1-302f5bf4ead8 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:05:20.993266 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-55d20b29-2fd6-44ff-9fd1-302f5bf4ead8 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:05:20.994961 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-55d20b29-2fd6-44ff-9fd1-302f5bf4ead8 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:05:21.439457 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-03ca7747-061e-43ee-8bf6-5fb38fafcc1e tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:05:21.441890 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-03ca7747-061e-43ee-8bf6-5fb38fafcc1e tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] [instance: 0ae0d266-c297-45f1-80fe-0e8f84cc22e6] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:05:21.457650 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-55d20b29-2fd6-44ff-9fd1-302f5bf4ead8 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:05:21.463210 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-55d20b29-2fd6-44ff-9fd1-302f5bf4ead8 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:05:21.464001 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.objects.instance [None req-55d20b29-2fd6-44ff-9fd1-302f5bf4ead8 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lazy-loading 'fault' on Instance uuid be65ea57-bc8d-4bce-80c3-33d8b6007ed1 {{(pid=98154) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Feb 19 05:05:21.476683 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-03ca7747-061e-43ee-8bf6-5fb38fafcc1e tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:05:21.477555 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-03ca7747-061e-43ee-8bf6-5fb38fafcc1e tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:05:21.478999 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-03ca7747-061e-43ee-8bf6-5fb38fafcc1e tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:05:21.486396 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-03ca7747-061e-43ee-8bf6-5fb38fafcc1e tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:05:21.682454 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-55d20b29-2fd6-44ff-9fd1-302f5bf4ead8 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3274478c0a421895f43618dc827ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50941a0cab243e9a320ff22a7648de6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:05:21.693025 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-55d20b29-2fd6-44ff-9fd1-302f5bf4ead8 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] 10.222.0.47 "GET /compute/v2.1/servers/be65ea57-bc8d-4bce-80c3-33d8b6007ed1" status: 200 len: 1325 microversion: 2.1 time: 0.744004 Feb 19 05:05:21.697436 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 377/747] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:05:20 2021] GET /compute/v2.1/servers/be65ea57-bc8d-4bce-80c3-33d8b6007ed1 => generated 1325 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:05:21.708043 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-122dfd89-6b09-4516-a36c-1d80411244a6 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:05:21.713856 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-122dfd89-6b09-4516-a36c-1d80411244a6 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] [instance: dcb11872-0660-4e35-8d91-bfe80088844b] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:05:21.734638 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-122dfd89-6b09-4516-a36c-1d80411244a6 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:05:21.735597 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-122dfd89-6b09-4516-a36c-1d80411244a6 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:05:21.737203 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-122dfd89-6b09-4516-a36c-1d80411244a6 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:05:21.738135 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-122dfd89-6b09-4516-a36c-1d80411244a6 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:05:21.996414 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-122dfd89-6b09-4516-a36c-1d80411244a6 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] 10.222.0.47 "POST /compute/v2.1/servers/dcb11872-0660-4e35-8d91-bfe80088844b/action" status: 200 len: 14 microversion: 2.20 time: 0.295154 Feb 19 05:05:21.998039 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 378/748] 10.222.0.47 () {62 vars in 1309 bytes} [Fri Feb 19 05:05:21 2021] POST /compute/v2.1/servers/dcb11872-0660-4e35-8d91-bfe80088844b/action => generated 14 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:05:22.191221 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-03ca7747-061e-43ee-8bf6-5fb38fafcc1e tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5df26a2a7e854705800096f12d30c8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3309eb07e18a46a2a0bcbde1f9e46dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:05:22.203588 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-03ca7747-061e-43ee-8bf6-5fb38fafcc1e tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] 10.222.0.47 "GET /compute/v2.1/servers/0ae0d266-c297-45f1-80fe-0e8f84cc22e6" status: 200 len: 1760 microversion: 2.1 time: 0.788824 Feb 19 05:05:22.204557 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 371/749] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:05:21 2021] GET /compute/v2.1/servers/0ae0d266-c297-45f1-80fe-0e8f84cc22e6 => generated 1760 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:05:22.719578 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-ac6e331a-dc25-4f60-9a6a-f69451af9516 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:05:22.721009 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-ac6e331a-dc25-4f60-9a6a-f69451af9516 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] [instance: be65ea57-bc8d-4bce-80c3-33d8b6007ed1] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:05:22.731364 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-ac6e331a-dc25-4f60-9a6a-f69451af9516 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:05:22.732122 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-ac6e331a-dc25-4f60-9a6a-f69451af9516 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:05:22.734001 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-ac6e331a-dc25-4f60-9a6a-f69451af9516 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:05:22.735274 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-ac6e331a-dc25-4f60-9a6a-f69451af9516 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:05:22.798674 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.wsgi [None req-ac6e331a-dc25-4f60-9a6a-f69451af9516 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] HTTP exception thrown: Instance be65ea57-bc8d-4bce-80c3-33d8b6007ed1 could not be found. Feb 19 05:05:22.799520 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-ac6e331a-dc25-4f60-9a6a-f69451af9516 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Returning 404 to user: Instance be65ea57-bc8d-4bce-80c3-33d8b6007ed1 could not be found. {{(pid=98154) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 19 05:05:22.800689 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-ac6e331a-dc25-4f60-9a6a-f69451af9516 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] 10.222.0.47 "GET /compute/v2.1/servers/be65ea57-bc8d-4bce-80c3-33d8b6007ed1" status: 404 len: 111 microversion: 2.1 time: 0.087438 Feb 19 05:05:22.801854 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 379/750] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:05:22 2021] GET /compute/v2.1/servers/be65ea57-bc8d-4bce-80c3-33d8b6007ed1 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 05:05:22.815738 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-f80cc23b-4ec2-4c97-9fbd-cabba535c3af tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Calling method '.version_select at 0x7f27069529d8>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:05:22.844892 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-f80cc23b-4ec2-4c97-9fbd-cabba535c3af tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-61000085" status: 202 len: 0 microversion: 2.1 time: 0.035265 Feb 19 05:05:22.845752 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 372/751] 10.222.0.47 () {58 vars in 1205 bytes} [Fri Feb 19 05:05:22 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-61000085 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 19 05:05:23.018270 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-7e2bbe54-ce5a-4730-a714-bb08461049be tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:05:23.020350 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-7e2bbe54-ce5a-4730-a714-bb08461049be tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] [instance: dcb11872-0660-4e35-8d91-bfe80088844b] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:05:23.037982 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-7e2bbe54-ce5a-4730-a714-bb08461049be tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:05:23.038826 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-7e2bbe54-ce5a-4730-a714-bb08461049be tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:05:23.040488 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-7e2bbe54-ce5a-4730-a714-bb08461049be tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:05:23.041412 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-7e2bbe54-ce5a-4730-a714-bb08461049be tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:05:23.238483 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-785ec5aa-73fa-4538-a920-018e9f4043b6 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:05:23.242218 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-785ec5aa-73fa-4538-a920-018e9f4043b6 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] [instance: 0ae0d266-c297-45f1-80fe-0e8f84cc22e6] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:05:23.263934 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-785ec5aa-73fa-4538-a920-018e9f4043b6 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:05:23.266957 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-785ec5aa-73fa-4538-a920-018e9f4043b6 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:05:23.268330 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-7e2bbe54-ce5a-4730-a714-bb08461049be tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] 10.222.0.47 "POST /compute/v2.1/servers/dcb11872-0660-4e35-8d91-bfe80088844b/action" status: 200 len: 14 microversion: 2.20 time: 0.260445 Feb 19 05:05:23.269158 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-785ec5aa-73fa-4538-a920-018e9f4043b6 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:05:23.270111 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 380/752] 10.222.0.47 () {62 vars in 1309 bytes} [Fri Feb 19 05:05:23 2021] POST /compute/v2.1/servers/dcb11872-0660-4e35-8d91-bfe80088844b/action => generated 14 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 05:05:23.275790 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-785ec5aa-73fa-4538-a920-018e9f4043b6 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:05:23.600904 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-785ec5aa-73fa-4538-a920-018e9f4043b6 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5df26a2a7e854705800096f12d30c8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3309eb07e18a46a2a0bcbde1f9e46dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:05:23.623814 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-785ec5aa-73fa-4538-a920-018e9f4043b6 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] 10.222.0.47 "GET /compute/v2.1/servers/0ae0d266-c297-45f1-80fe-0e8f84cc22e6" status: 200 len: 1765 microversion: 2.1 time: 0.386932 Feb 19 05:05:23.623814 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 373/753] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:05:23 2021] GET /compute/v2.1/servers/0ae0d266-c297-45f1-80fe-0e8f84cc22e6 => generated 1765 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 05:05:24.281526 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-864090fd-31aa-4714-b02a-937eebd85ce8 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:05:24.284215 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-864090fd-31aa-4714-b02a-937eebd85ce8 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] [instance: dcb11872-0660-4e35-8d91-bfe80088844b] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:05:24.297960 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-864090fd-31aa-4714-b02a-937eebd85ce8 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:05:24.298752 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-864090fd-31aa-4714-b02a-937eebd85ce8 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:05:24.299881 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-864090fd-31aa-4714-b02a-937eebd85ce8 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:05:24.301325 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-864090fd-31aa-4714-b02a-937eebd85ce8 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:05:24.471198 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-864090fd-31aa-4714-b02a-937eebd85ce8 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] 10.222.0.47 "POST /compute/v2.1/servers/dcb11872-0660-4e35-8d91-bfe80088844b/action" status: 200 len: 14 microversion: 2.20 time: 0.194264 Feb 19 05:05:24.475502 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 381/754] 10.222.0.47 () {62 vars in 1309 bytes} [Fri Feb 19 05:05:24 2021] POST /compute/v2.1/servers/dcb11872-0660-4e35-8d91-bfe80088844b/action => generated 14 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:05:24.645139 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-17e6b8d2-ed7f-4240-a451-52367be50c5e tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:05:24.646913 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-17e6b8d2-ed7f-4240-a451-52367be50c5e tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] [instance: 0ae0d266-c297-45f1-80fe-0e8f84cc22e6] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:05:24.662065 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-17e6b8d2-ed7f-4240-a451-52367be50c5e tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:05:24.663453 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-17e6b8d2-ed7f-4240-a451-52367be50c5e tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:05:24.665891 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-17e6b8d2-ed7f-4240-a451-52367be50c5e tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:05:24.667550 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-17e6b8d2-ed7f-4240-a451-52367be50c5e tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:05:24.839862 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-72b6c1fd-15d1-4dd1-b678-26bd7bc62a6e tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Action: 'create', calling method: .version_select at 0x7f270736fa60>, body: {"keypair": {"name": "tempest-keypair-291383576"}} {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:05:24.886277 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.quota [None req-72b6c1fd-15d1-4dd1-b678-26bd7bc62a6e tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Getting quotas for project e50941a0cab243e9a320ff22a7648de6. Resources: {'key_pairs'} {{(pid=98154) _get_quotas /opt/stack/nova/nova/quota.py:388}} Feb 19 05:05:24.896095 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.quota [None req-72b6c1fd-15d1-4dd1-b678-26bd7bc62a6e tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Getting quotas for user 7a3274478c0a421895f43618dc827ea9 and project e50941a0cab243e9a320ff22a7648de6. Resources: {'key_pairs'} {{(pid=98154) _get_quotas /opt/stack/nova/nova/quota.py:380}} Feb 19 05:05:25.085381 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-17e6b8d2-ed7f-4240-a451-52367be50c5e tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5df26a2a7e854705800096f12d30c8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3309eb07e18a46a2a0bcbde1f9e46dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:05:25.104803 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-17e6b8d2-ed7f-4240-a451-52367be50c5e tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] 10.222.0.47 "GET /compute/v2.1/servers/0ae0d266-c297-45f1-80fe-0e8f84cc22e6" status: 200 len: 1765 microversion: 2.1 time: 0.466648 Feb 19 05:05:25.116665 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 374/755] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:05:24 2021] GET /compute/v2.1/servers/0ae0d266-c297-45f1-80fe-0e8f84cc22e6 => generated 1765 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:05:25.489329 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-bc20248e-f9fa-4905-910e-d29f964c3b73 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:05:25.494828 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-bc20248e-f9fa-4905-910e-d29f964c3b73 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] [instance: dcb11872-0660-4e35-8d91-bfe80088844b] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:05:25.539374 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-bc20248e-f9fa-4905-910e-d29f964c3b73 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:05:25.544950 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-bc20248e-f9fa-4905-910e-d29f964c3b73 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:05:25.547084 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-bc20248e-f9fa-4905-910e-d29f964c3b73 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:05:25.548043 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-bc20248e-f9fa-4905-910e-d29f964c3b73 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:05:25.767109 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-bc20248e-f9fa-4905-910e-d29f964c3b73 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] 10.222.0.47 "POST /compute/v2.1/servers/dcb11872-0660-4e35-8d91-bfe80088844b/action" status: 200 len: 14 microversion: 2.20 time: 0.286545 Feb 19 05:05:25.768111 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 375/756] 10.222.0.47 () {62 vars in 1309 bytes} [Fri Feb 19 05:05:25 2021] POST /compute/v2.1/servers/dcb11872-0660-4e35-8d91-bfe80088844b/action => generated 14 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:05:25.856797 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.quota [None req-72b6c1fd-15d1-4dd1-b678-26bd7bc62a6e tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Getting quotas for project e50941a0cab243e9a320ff22a7648de6. Resources: {'key_pairs'} {{(pid=98154) _get_quotas /opt/stack/nova/nova/quota.py:388}} Feb 19 05:05:25.863052 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.quota [None req-72b6c1fd-15d1-4dd1-b678-26bd7bc62a6e tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Getting quotas for user 7a3274478c0a421895f43618dc827ea9 and project e50941a0cab243e9a320ff22a7648de6. Resources: {'key_pairs'} {{(pid=98154) _get_quotas /opt/stack/nova/nova/quota.py:380}} Feb 19 05:05:25.879785 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-72b6c1fd-15d1-4dd1-b678-26bd7bc62a6e tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 2304 microversion: 2.1 time: 1.049956 Feb 19 05:05:25.880493 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 382/757] 10.222.0.47 () {60 vars in 1148 bytes} [Fri Feb 19 05:05:24 2021] POST /compute/v2.1/os-keypairs => generated 2304 bytes in 1052 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:05:26.126606 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-f4dc8161-936d-44d9-af34-4aa253c9005e tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:05:26.127936 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-f4dc8161-936d-44d9-af34-4aa253c9005e tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] [instance: 0ae0d266-c297-45f1-80fe-0e8f84cc22e6] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:05:26.137765 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-f4dc8161-936d-44d9-af34-4aa253c9005e tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:05:26.138246 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-f4dc8161-936d-44d9-af34-4aa253c9005e tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:05:26.139308 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-f4dc8161-936d-44d9-af34-4aa253c9005e tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:05:26.140048 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-f4dc8161-936d-44d9-af34-4aa253c9005e tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:05:26.457485 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-f4dc8161-936d-44d9-af34-4aa253c9005e tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5df26a2a7e854705800096f12d30c8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3309eb07e18a46a2a0bcbde1f9e46dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:05:26.482291 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-f4dc8161-936d-44d9-af34-4aa253c9005e tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] 10.222.0.47 "GET /compute/v2.1/servers/0ae0d266-c297-45f1-80fe-0e8f84cc22e6" status: 200 len: 1765 microversion: 2.1 time: 0.360485 Feb 19 05:05:26.484113 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 376/758] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:05:26 2021] GET /compute/v2.1/servers/0ae0d266-c297-45f1-80fe-0e8f84cc22e6 => generated 1765 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 05:05:26.790937 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-1246cee1-ea62-413e-85a8-0c8f5630bc05 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:05:26.793738 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-1246cee1-ea62-413e-85a8-0c8f5630bc05 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] [instance: dcb11872-0660-4e35-8d91-bfe80088844b] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:05:26.817954 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-1246cee1-ea62-413e-85a8-0c8f5630bc05 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:05:26.819382 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-1246cee1-ea62-413e-85a8-0c8f5630bc05 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:05:26.821775 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-1246cee1-ea62-413e-85a8-0c8f5630bc05 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:05:26.823245 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-1246cee1-ea62-413e-85a8-0c8f5630bc05 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:05:27.059360 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-1246cee1-ea62-413e-85a8-0c8f5630bc05 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] 10.222.0.47 "POST /compute/v2.1/servers/dcb11872-0660-4e35-8d91-bfe80088844b/action" status: 200 len: 14 microversion: 2.20 time: 0.279909 Feb 19 05:05:27.061071 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 383/759] 10.222.0.47 () {62 vars in 1309 bytes} [Fri Feb 19 05:05:26 2021] POST /compute/v2.1/servers/dcb11872-0660-4e35-8d91-bfe80088844b/action => generated 14 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:05:27.504021 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-b344f175-6dfd-4094-9bc0-88659a9b508b tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:05:27.505125 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-b344f175-6dfd-4094-9bc0-88659a9b508b tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] [instance: 0ae0d266-c297-45f1-80fe-0e8f84cc22e6] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:05:27.523711 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-b344f175-6dfd-4094-9bc0-88659a9b508b tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:05:27.524683 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-b344f175-6dfd-4094-9bc0-88659a9b508b tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:05:27.526033 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-b344f175-6dfd-4094-9bc0-88659a9b508b tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:05:27.526762 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-b344f175-6dfd-4094-9bc0-88659a9b508b tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:05:27.792604 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-b344f175-6dfd-4094-9bc0-88659a9b508b tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5df26a2a7e854705800096f12d30c8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3309eb07e18a46a2a0bcbde1f9e46dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:05:27.806988 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-b344f175-6dfd-4094-9bc0-88659a9b508b tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] 10.222.0.47 "GET /compute/v2.1/servers/0ae0d266-c297-45f1-80fe-0e8f84cc22e6" status: 200 len: 1765 microversion: 2.1 time: 0.307725 Feb 19 05:05:27.808100 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 377/760] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:05:27 2021] GET /compute/v2.1/servers/0ae0d266-c297-45f1-80fe-0e8f84cc22e6 => generated 1765 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:05:28.078061 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-43ccbed4-9582-46dd-9912-f23b46cf5995 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:05:28.079619 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-43ccbed4-9582-46dd-9912-f23b46cf5995 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] [instance: dcb11872-0660-4e35-8d91-bfe80088844b] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:05:28.094199 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-43ccbed4-9582-46dd-9912-f23b46cf5995 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:05:28.095201 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-43ccbed4-9582-46dd-9912-f23b46cf5995 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:05:28.097335 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-43ccbed4-9582-46dd-9912-f23b46cf5995 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:05:28.098490 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-43ccbed4-9582-46dd-9912-f23b46cf5995 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:05:28.836876 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-0547f082-35d9-4935-b2b5-14777f7eb9e1 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:05:28.837654 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-0547f082-35d9-4935-b2b5-14777f7eb9e1 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] [instance: 0ae0d266-c297-45f1-80fe-0e8f84cc22e6] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:05:28.847475 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-0547f082-35d9-4935-b2b5-14777f7eb9e1 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:05:28.847970 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-0547f082-35d9-4935-b2b5-14777f7eb9e1 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:05:28.849038 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-0547f082-35d9-4935-b2b5-14777f7eb9e1 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:05:28.849529 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-0547f082-35d9-4935-b2b5-14777f7eb9e1 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:05:29.133987 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-0547f082-35d9-4935-b2b5-14777f7eb9e1 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5df26a2a7e854705800096f12d30c8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3309eb07e18a46a2a0bcbde1f9e46dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:05:29.144168 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-0547f082-35d9-4935-b2b5-14777f7eb9e1 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] 10.222.0.47 "GET /compute/v2.1/servers/0ae0d266-c297-45f1-80fe-0e8f84cc22e6" status: 200 len: 1765 microversion: 2.1 time: 0.311861 Feb 19 05:05:29.144834 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 378/761] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:05:28 2021] GET /compute/v2.1/servers/0ae0d266-c297-45f1-80fe-0e8f84cc22e6 => generated 1765 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 05:05:29.150451 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-9c3d96c0-82d8-44df-b19c-174e61545a49 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-389335272", "imageRef": "53cdf9de-e495-4ca8-845f-6be2bf32cecb", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f5994d75-3690-4c0d-a23c-9728f5c2f0cf"}], "security_groups": [{"name": "tempest-securitygroup--600455170"}], "key_name": "tempest-keypair-291383576", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:05:29.315115 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.network.neutron [None req-9c3d96c0-82d8-44df-b19c-174e61545a49 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] validate_networks() for [('f5994d75-3690-4c0d-a23c-9728f5c2f0cf', None, None, None)] {{(pid=98153) validate_networks /opt/stack/nova/nova/network/neutron.py:2345}} Feb 19 05:05:30.093441 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.virt.hardware [None req-9c3d96c0-82d8-44df-b19c-174e61545a49 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Flavor limits 0:0:0 {{(pid=98153) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 19 05:05:30.094110 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.virt.hardware [None req-9c3d96c0-82d8-44df-b19c-174e61545a49 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Image limits 0:0:0 {{(pid=98153) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Feb 19 05:05:30.094476 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.virt.hardware [None req-9c3d96c0-82d8-44df-b19c-174e61545a49 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Flavor pref 0:0:0 {{(pid=98153) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 19 05:05:30.094937 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.virt.hardware [None req-9c3d96c0-82d8-44df-b19c-174e61545a49 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Image pref 0:0:0 {{(pid=98153) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Feb 19 05:05:30.095445 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.virt.hardware [None req-9c3d96c0-82d8-44df-b19c-174e61545a49 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98153) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Feb 19 05:05:30.105588 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-9c3d96c0-82d8-44df-b19c-174e61545a49 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:05:30.106103 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-9c3d96c0-82d8-44df-b19c-174e61545a49 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:05:30.107050 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-9c3d96c0-82d8-44df-b19c-174e61545a49 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:05:30.107620 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-9c3d96c0-82d8-44df-b19c-174e61545a49 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:05:30.130216 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.quota [None req-9c3d96c0-82d8-44df-b19c-174e61545a49 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Getting quotas for project e50941a0cab243e9a320ff22a7648de6. Resources: {'instances', 'ram', 'cores'} {{(pid=98153) _get_quotas /opt/stack/nova/nova/quota.py:388}} Feb 19 05:05:30.135385 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.quota [None req-9c3d96c0-82d8-44df-b19c-174e61545a49 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Getting quotas for user 7a3274478c0a421895f43618dc827ea9 and project e50941a0cab243e9a320ff22a7648de6. Resources: {'instances', 'ram', 'cores'} {{(pid=98153) _get_quotas /opt/stack/nova/nova/quota.py:380}} Feb 19 05:05:30.150393 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-9c3d96c0-82d8-44df-b19c-174e61545a49 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Going to run 1 instances... {{(pid=98153) _provision_instances /opt/stack/nova/nova/compute/api.py:1264}} Feb 19 05:05:30.153718 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-9c3d96c0-82d8-44df-b19c-174e61545a49 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] [instance: f5e90100-1612-4e18-b86c-db90e3045760] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='53cdf9de-e495-4ca8-845f-6be2bf32cecb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98153) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1666}} Feb 19 05:05:30.213823 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-9c3d96c0-82d8-44df-b19c-174e61545a49 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.067797 Feb 19 05:05:30.214557 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 379/762] 10.222.0.47 () {60 vars in 1137 bytes} [Fri Feb 19 05:05:29 2021] POST /compute/v2.1/servers => generated 401 bytes in 1069 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 19 05:05:30.220433 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-2422a2da-d295-4650-9e3a-9a8388b7dd12 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:05:30.221116 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-2422a2da-d295-4650-9e3a-9a8388b7dd12 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] [instance: 0ae0d266-c297-45f1-80fe-0e8f84cc22e6] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:05:30.234783 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-2422a2da-d295-4650-9e3a-9a8388b7dd12 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:05:30.235642 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-2422a2da-d295-4650-9e3a-9a8388b7dd12 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:05:30.237044 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-2422a2da-d295-4650-9e3a-9a8388b7dd12 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:05:30.237862 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-2422a2da-d295-4650-9e3a-9a8388b7dd12 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:05:30.505522 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-43ccbed4-9582-46dd-9912-f23b46cf5995 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] 10.222.0.47 "POST /compute/v2.1/servers/dcb11872-0660-4e35-8d91-bfe80088844b/action" status: 200 len: 15273 microversion: 2.20 time: 2.435022 Feb 19 05:05:30.507303 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 384/763] 10.222.0.47 () {62 vars in 1309 bytes} [Fri Feb 19 05:05:28 2021] POST /compute/v2.1/servers/dcb11872-0660-4e35-8d91-bfe80088844b/action => generated 15273 bytes in 2439 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 19 05:05:30.520286 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-c0c77f80-c531-4218-8206-2fcae9c85957 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:05:30.522332 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-c0c77f80-c531-4218-8206-2fcae9c85957 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] [instance: f5e90100-1612-4e18-b86c-db90e3045760] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:05:30.653874 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-c0c77f80-c531-4218-8206-2fcae9c85957 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3274478c0a421895f43618dc827ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50941a0cab243e9a320ff22a7648de6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:05:30.665734 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-2422a2da-d295-4650-9e3a-9a8388b7dd12 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5df26a2a7e854705800096f12d30c8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3309eb07e18a46a2a0bcbde1f9e46dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:05:30.673827 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-c0c77f80-c531-4218-8206-2fcae9c85957 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] 10.222.0.47 "GET /compute/v2.1/servers/f5e90100-1612-4e18-b86c-db90e3045760" status: 200 len: 1236 microversion: 2.1 time: 0.163123 Feb 19 05:05:30.674960 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 385/764] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:05:30 2021] GET /compute/v2.1/servers/f5e90100-1612-4e18-b86c-db90e3045760 => generated 1236 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:05:30.681259 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-2422a2da-d295-4650-9e3a-9a8388b7dd12 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] 10.222.0.47 "GET /compute/v2.1/servers/0ae0d266-c297-45f1-80fe-0e8f84cc22e6" status: 200 len: 1765 microversion: 2.1 time: 0.465508 Feb 19 05:05:30.682503 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 380/765] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:05:30 2021] GET /compute/v2.1/servers/0ae0d266-c297-45f1-80fe-0e8f84cc22e6 => generated 1765 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:05:31.519792 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-a542ffda-105d-4493-9f3e-8d2ecf4d4311 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:05:31.520913 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-a542ffda-105d-4493-9f3e-8d2ecf4d4311 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] [instance: dcb11872-0660-4e35-8d91-bfe80088844b] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:05:31.530947 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-a542ffda-105d-4493-9f3e-8d2ecf4d4311 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:05:31.531515 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-a542ffda-105d-4493-9f3e-8d2ecf4d4311 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:05:31.532500 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-a542ffda-105d-4493-9f3e-8d2ecf4d4311 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:05:31.533004 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-a542ffda-105d-4493-9f3e-8d2ecf4d4311 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:05:31.674559 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-a542ffda-105d-4493-9f3e-8d2ecf4d4311 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] 10.222.0.47 "POST /compute/v2.1/servers/dcb11872-0660-4e35-8d91-bfe80088844b/action" status: 200 len: 18003 microversion: 2.20 time: 0.158740 Feb 19 05:05:31.679281 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 386/766] 10.222.0.47 () {62 vars in 1309 bytes} [Fri Feb 19 05:05:31 2021] POST /compute/v2.1/servers/dcb11872-0660-4e35-8d91-bfe80088844b/action => generated 18003 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 19 05:05:31.709722 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-239be782-8e75-4c65-9073-30d72a5034ed tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:05:31.711233 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-c4d8c7df-ae83-42d3-a1e3-8121b82ffb92 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:05:31.712221 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-c4d8c7df-ae83-42d3-a1e3-8121b82ffb92 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] [instance: f5e90100-1612-4e18-b86c-db90e3045760] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:05:31.714576 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-239be782-8e75-4c65-9073-30d72a5034ed tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] [instance: 0ae0d266-c297-45f1-80fe-0e8f84cc22e6] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:05:31.732121 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-c4d8c7df-ae83-42d3-a1e3-8121b82ffb92 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:05:31.733555 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-c4d8c7df-ae83-42d3-a1e3-8121b82ffb92 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:05:31.735772 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-c4d8c7df-ae83-42d3-a1e3-8121b82ffb92 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:05:31.736997 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-239be782-8e75-4c65-9073-30d72a5034ed tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:05:31.738262 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-239be782-8e75-4c65-9073-30d72a5034ed tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:05:31.738716 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-c4d8c7df-ae83-42d3-a1e3-8121b82ffb92 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:05:31.742183 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-239be782-8e75-4c65-9073-30d72a5034ed tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:05:31.742916 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-239be782-8e75-4c65-9073-30d72a5034ed tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:05:32.194549 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-c4d8c7df-ae83-42d3-a1e3-8121b82ffb92 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3274478c0a421895f43618dc827ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50941a0cab243e9a320ff22a7648de6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:05:32.210820 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-c4d8c7df-ae83-42d3-a1e3-8121b82ffb92 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] 10.222.0.47 "GET /compute/v2.1/servers/f5e90100-1612-4e18-b86c-db90e3045760" status: 200 len: 1306 microversion: 2.1 time: 0.511699 Feb 19 05:05:32.212266 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 381/767] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:05:31 2021] GET /compute/v2.1/servers/f5e90100-1612-4e18-b86c-db90e3045760 => generated 1306 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:05:32.429588 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-239be782-8e75-4c65-9073-30d72a5034ed tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5df26a2a7e854705800096f12d30c8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3309eb07e18a46a2a0bcbde1f9e46dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:05:32.443087 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-239be782-8e75-4c65-9073-30d72a5034ed tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] 10.222.0.47 "GET /compute/v2.1/servers/0ae0d266-c297-45f1-80fe-0e8f84cc22e6" status: 200 len: 1765 microversion: 2.1 time: 0.742972 Feb 19 05:05:32.443792 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 387/768] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:05:31 2021] GET /compute/v2.1/servers/0ae0d266-c297-45f1-80fe-0e8f84cc22e6 => generated 1765 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:05:32.687037 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-a3ad20d1-50e9-405a-a0dc-f50fc5a4baec tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:05:32.688463 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-a3ad20d1-50e9-405a-a0dc-f50fc5a4baec tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] [instance: dcb11872-0660-4e35-8d91-bfe80088844b] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:05:32.697300 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-a3ad20d1-50e9-405a-a0dc-f50fc5a4baec tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:05:32.697812 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-a3ad20d1-50e9-405a-a0dc-f50fc5a4baec tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:05:32.698675 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-a3ad20d1-50e9-405a-a0dc-f50fc5a4baec tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:05:32.699167 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-a3ad20d1-50e9-405a-a0dc-f50fc5a4baec tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:05:33.231595 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-e671ef1b-b071-4b2b-9181-65ac5daaa279 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:05:33.232414 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-e671ef1b-b071-4b2b-9181-65ac5daaa279 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] [instance: f5e90100-1612-4e18-b86c-db90e3045760] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:05:33.241679 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-e671ef1b-b071-4b2b-9181-65ac5daaa279 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:05:33.242281 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-e671ef1b-b071-4b2b-9181-65ac5daaa279 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:05:33.243261 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-e671ef1b-b071-4b2b-9181-65ac5daaa279 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:05:33.243771 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-e671ef1b-b071-4b2b-9181-65ac5daaa279 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:05:33.390705 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-e671ef1b-b071-4b2b-9181-65ac5daaa279 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3274478c0a421895f43618dc827ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50941a0cab243e9a320ff22a7648de6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:05:33.409539 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-e671ef1b-b071-4b2b-9181-65ac5daaa279 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] 10.222.0.47 "GET /compute/v2.1/servers/f5e90100-1612-4e18-b86c-db90e3045760" status: 200 len: 1294 microversion: 2.1 time: 0.181552 Feb 19 05:05:33.410652 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 388/769] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:05:33 2021] GET /compute/v2.1/servers/f5e90100-1612-4e18-b86c-db90e3045760 => generated 1294 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 05:05:33.472929 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-f6c639c7-7170-4498-9a3d-127adbb257af tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:05:33.474171 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-f6c639c7-7170-4498-9a3d-127adbb257af tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] [instance: 0ae0d266-c297-45f1-80fe-0e8f84cc22e6] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:05:33.484408 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-f6c639c7-7170-4498-9a3d-127adbb257af tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:05:33.485507 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-f6c639c7-7170-4498-9a3d-127adbb257af tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:05:33.486615 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-f6c639c7-7170-4498-9a3d-127adbb257af tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:05:33.487311 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-f6c639c7-7170-4498-9a3d-127adbb257af tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:05:33.989905 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-f6c639c7-7170-4498-9a3d-127adbb257af tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5df26a2a7e854705800096f12d30c8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3309eb07e18a46a2a0bcbde1f9e46dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:05:34.000512 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-f6c639c7-7170-4498-9a3d-127adbb257af tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] 10.222.0.47 "GET /compute/v2.1/servers/0ae0d266-c297-45f1-80fe-0e8f84cc22e6" status: 200 len: 1765 microversion: 2.1 time: 0.541508 Feb 19 05:05:34.001504 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 389/770] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:05:33 2021] GET /compute/v2.1/servers/0ae0d266-c297-45f1-80fe-0e8f84cc22e6 => generated 1765 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:05:34.434680 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-147fbe87-1065-4cc6-bdda-1ead2c9cffec tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:05:34.435406 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-147fbe87-1065-4cc6-bdda-1ead2c9cffec tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] [instance: f5e90100-1612-4e18-b86c-db90e3045760] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:05:34.444052 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-147fbe87-1065-4cc6-bdda-1ead2c9cffec tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:05:34.444561 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-147fbe87-1065-4cc6-bdda-1ead2c9cffec tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:05:34.445429 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-147fbe87-1065-4cc6-bdda-1ead2c9cffec tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:05:34.445921 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-147fbe87-1065-4cc6-bdda-1ead2c9cffec tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:05:34.699196 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-147fbe87-1065-4cc6-bdda-1ead2c9cffec tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3274478c0a421895f43618dc827ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50941a0cab243e9a320ff22a7648de6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:05:34.708637 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-147fbe87-1065-4cc6-bdda-1ead2c9cffec tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] 10.222.0.47 "GET /compute/v2.1/servers/f5e90100-1612-4e18-b86c-db90e3045760" status: 200 len: 1361 microversion: 2.1 time: 0.278010 Feb 19 05:05:34.709279 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 390/771] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:05:34 2021] GET /compute/v2.1/servers/f5e90100-1612-4e18-b86c-db90e3045760 => generated 1361 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:05:35.020649 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-bcce4521-344e-40a5-a5ba-c37c895384eb tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:05:35.021306 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-bcce4521-344e-40a5-a5ba-c37c895384eb tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] [instance: 0ae0d266-c297-45f1-80fe-0e8f84cc22e6] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:05:35.029389 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-bcce4521-344e-40a5-a5ba-c37c895384eb tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:05:35.030562 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-bcce4521-344e-40a5-a5ba-c37c895384eb tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:05:35.031446 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-bcce4521-344e-40a5-a5ba-c37c895384eb tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:05:35.031973 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-bcce4521-344e-40a5-a5ba-c37c895384eb tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:05:35.258623 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-bcce4521-344e-40a5-a5ba-c37c895384eb tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5df26a2a7e854705800096f12d30c8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3309eb07e18a46a2a0bcbde1f9e46dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:05:35.268586 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-bcce4521-344e-40a5-a5ba-c37c895384eb tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] 10.222.0.47 "GET /compute/v2.1/servers/0ae0d266-c297-45f1-80fe-0e8f84cc22e6" status: 200 len: 1765 microversion: 2.1 time: 0.252011 Feb 19 05:05:35.269214 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 391/772] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:05:35 2021] GET /compute/v2.1/servers/0ae0d266-c297-45f1-80fe-0e8f84cc22e6 => generated 1765 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 05:05:35.534607 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-a3ad20d1-50e9-405a-a0dc-f50fc5a4baec tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] 10.222.0.47 "POST /compute/v2.1/servers/dcb11872-0660-4e35-8d91-bfe80088844b/action" status: 200 len: 23659 microversion: 2.20 time: 2.851551 Feb 19 05:05:35.535501 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 382/773] 10.222.0.47 () {62 vars in 1309 bytes} [Fri Feb 19 05:05:32 2021] POST /compute/v2.1/servers/dcb11872-0660-4e35-8d91-bfe80088844b/action => generated 23659 bytes in 2853 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 19 05:05:35.726213 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-b0b410af-92f3-4992-88c0-727c4341670e tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:05:35.726875 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-b0b410af-92f3-4992-88c0-727c4341670e tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] [instance: f5e90100-1612-4e18-b86c-db90e3045760] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:05:35.735201 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-b0b410af-92f3-4992-88c0-727c4341670e tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:05:35.735741 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-b0b410af-92f3-4992-88c0-727c4341670e tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:05:35.736611 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-b0b410af-92f3-4992-88c0-727c4341670e tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:05:35.737834 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-b0b410af-92f3-4992-88c0-727c4341670e tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:05:36.158586 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-b0b410af-92f3-4992-88c0-727c4341670e tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3274478c0a421895f43618dc827ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50941a0cab243e9a320ff22a7648de6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:05:36.169174 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-b0b410af-92f3-4992-88c0-727c4341670e tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] 10.222.0.47 "GET /compute/v2.1/servers/f5e90100-1612-4e18-b86c-db90e3045760" status: 200 len: 1361 microversion: 2.1 time: 0.446781 Feb 19 05:05:36.171387 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 392/774] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:05:35 2021] GET /compute/v2.1/servers/f5e90100-1612-4e18-b86c-db90e3045760 => generated 1361 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:05:36.289232 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-d5d9bf13-d653-4b7f-bb6f-bab47687d562 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:05:36.290187 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-d5d9bf13-d653-4b7f-bb6f-bab47687d562 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] [instance: 0ae0d266-c297-45f1-80fe-0e8f84cc22e6] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:05:36.300402 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-d5d9bf13-d653-4b7f-bb6f-bab47687d562 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:05:36.301107 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-d5d9bf13-d653-4b7f-bb6f-bab47687d562 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:05:36.302089 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-d5d9bf13-d653-4b7f-bb6f-bab47687d562 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:05:36.302693 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-d5d9bf13-d653-4b7f-bb6f-bab47687d562 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:05:36.548998 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-4d71279d-4407-4301-999f-d1bf6fbdf53a tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:05:36.550484 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-4d71279d-4407-4301-999f-d1bf6fbdf53a tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] [instance: dcb11872-0660-4e35-8d91-bfe80088844b] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:05:36.566403 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-4d71279d-4407-4301-999f-d1bf6fbdf53a tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:05:36.567990 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-4d71279d-4407-4301-999f-d1bf6fbdf53a tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:05:36.572313 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-4d71279d-4407-4301-999f-d1bf6fbdf53a tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:05:36.573085 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-4d71279d-4407-4301-999f-d1bf6fbdf53a tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:05:36.733654 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-4d71279d-4407-4301-999f-d1bf6fbdf53a tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] 10.222.0.47 "POST /compute/v2.1/servers/dcb11872-0660-4e35-8d91-bfe80088844b/action" status: 200 len: 24823 microversion: 2.20 time: 0.189507 Feb 19 05:05:36.735069 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 393/775] 10.222.0.47 () {62 vars in 1309 bytes} [Fri Feb 19 05:05:36 2021] POST /compute/v2.1/servers/dcb11872-0660-4e35-8d91-bfe80088844b/action => generated 24823 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 19 05:05:36.765207 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-d5d9bf13-d653-4b7f-bb6f-bab47687d562 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5df26a2a7e854705800096f12d30c8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3309eb07e18a46a2a0bcbde1f9e46dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:05:36.774870 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-d5d9bf13-d653-4b7f-bb6f-bab47687d562 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] 10.222.0.47 "GET /compute/v2.1/servers/0ae0d266-c297-45f1-80fe-0e8f84cc22e6" status: 200 len: 1765 microversion: 2.1 time: 0.491432 Feb 19 05:05:36.775838 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 383/776] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:05:36 2021] GET /compute/v2.1/servers/0ae0d266-c297-45f1-80fe-0e8f84cc22e6 => generated 1765 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:05:37.192703 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-522d0253-9839-44a2-8e9e-877b8f54aa77 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:05:37.193621 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-522d0253-9839-44a2-8e9e-877b8f54aa77 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] [instance: f5e90100-1612-4e18-b86c-db90e3045760] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:05:37.203448 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-522d0253-9839-44a2-8e9e-877b8f54aa77 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:05:37.204078 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-522d0253-9839-44a2-8e9e-877b8f54aa77 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:05:37.205255 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-522d0253-9839-44a2-8e9e-877b8f54aa77 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:05:37.205902 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-522d0253-9839-44a2-8e9e-877b8f54aa77 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:05:37.560895 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-522d0253-9839-44a2-8e9e-877b8f54aa77 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3274478c0a421895f43618dc827ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50941a0cab243e9a320ff22a7648de6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:05:37.576778 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-522d0253-9839-44a2-8e9e-877b8f54aa77 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] 10.222.0.47 "GET /compute/v2.1/servers/f5e90100-1612-4e18-b86c-db90e3045760" status: 200 len: 1361 microversion: 2.1 time: 0.389037 Feb 19 05:05:37.578279 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 394/777] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:05:37 2021] GET /compute/v2.1/servers/f5e90100-1612-4e18-b86c-db90e3045760 => generated 1361 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:05:37.719213 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [req-da133f16-1d02-4abf-8997-b8e0e8678995 req-0b6ffe4d-c5d0-46f1-ace3-4eee41487be5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f5e90100-1612-4e18-b86c-db90e3045760", "tag": "e40bbdec-f58a-4faa-a0b4-30939473013f"}]} {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:05:37.721434 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 05:05:37.721434 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: warnings.warn(msg) Feb 19 05:05:37.733593 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [req-da133f16-1d02-4abf-8997-b8e0e8678995 req-0b6ffe4d-c5d0-46f1-ace3-4eee41487be5 service nova] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:05:37.734351 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [req-da133f16-1d02-4abf-8997-b8e0e8678995 req-0b6ffe4d-c5d0-46f1-ace3-4eee41487be5 service nova] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:05:37.749175 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-c4b01396-c888-4fdf-a96c-50f63b8b65b7 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:05:37.750586 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-c4b01396-c888-4fdf-a96c-50f63b8b65b7 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] [instance: dcb11872-0660-4e35-8d91-bfe80088844b] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:05:37.754620 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.compute.server_external_events [req-da133f16-1d02-4abf-8997-b8e0e8678995 req-0b6ffe4d-c5d0-46f1-ace3-4eee41487be5 service nova] Creating event network-changed:e40bbdec-f58a-4faa-a0b4-30939473013f for instance f5e90100-1612-4e18-b86c-db90e3045760 on hv-cinder-77642 Feb 19 05:05:37.760328 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [req-da133f16-1d02-4abf-8997-b8e0e8678995 req-0b6ffe4d-c5d0-46f1-ace3-4eee41487be5 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.251160 Feb 19 05:05:37.761256 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 384/778] 10.222.0.47 () {64 vars in 1308 bytes} [Fri Feb 19 05:05:37 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 19 05:05:37.761703 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-c4b01396-c888-4fdf-a96c-50f63b8b65b7 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:05:37.762354 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-c4b01396-c888-4fdf-a96c-50f63b8b65b7 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:05:37.763528 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-c4b01396-c888-4fdf-a96c-50f63b8b65b7 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:05:37.764423 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-c4b01396-c888-4fdf-a96c-50f63b8b65b7 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:05:37.798524 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-eacc89c7-6226-4d33-b65c-469d573603e3 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:05:37.799944 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-eacc89c7-6226-4d33-b65c-469d573603e3 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] [instance: 0ae0d266-c297-45f1-80fe-0e8f84cc22e6] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:05:37.809154 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-eacc89c7-6226-4d33-b65c-469d573603e3 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:05:37.809667 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-eacc89c7-6226-4d33-b65c-469d573603e3 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:05:37.810537 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-eacc89c7-6226-4d33-b65c-469d573603e3 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:05:37.811037 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-eacc89c7-6226-4d33-b65c-469d573603e3 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:05:38.105271 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-eacc89c7-6226-4d33-b65c-469d573603e3 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5df26a2a7e854705800096f12d30c8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3309eb07e18a46a2a0bcbde1f9e46dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:05:38.118907 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-eacc89c7-6226-4d33-b65c-469d573603e3 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] 10.222.0.47 "GET /compute/v2.1/servers/0ae0d266-c297-45f1-80fe-0e8f84cc22e6" status: 200 len: 1768 microversion: 2.1 time: 0.327011 Feb 19 05:05:38.119612 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 385/779] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:05:37 2021] GET /compute/v2.1/servers/0ae0d266-c297-45f1-80fe-0e8f84cc22e6 => generated 1768 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 05:05:38.596660 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-49582f33-e19d-4dc9-8ac9-c560de054c48 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:05:38.597363 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-49582f33-e19d-4dc9-8ac9-c560de054c48 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] [instance: f5e90100-1612-4e18-b86c-db90e3045760] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:05:38.605628 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-49582f33-e19d-4dc9-8ac9-c560de054c48 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:05:38.606135 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-49582f33-e19d-4dc9-8ac9-c560de054c48 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:05:38.607000 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-49582f33-e19d-4dc9-8ac9-c560de054c48 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:05:38.607523 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-49582f33-e19d-4dc9-8ac9-c560de054c48 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:05:38.844041 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-49582f33-e19d-4dc9-8ac9-c560de054c48 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3274478c0a421895f43618dc827ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50941a0cab243e9a320ff22a7648de6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:05:38.861574 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-49582f33-e19d-4dc9-8ac9-c560de054c48 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] 10.222.0.47 "GET /compute/v2.1/servers/f5e90100-1612-4e18-b86c-db90e3045760" status: 200 len: 1361 microversion: 2.1 time: 0.268895 Feb 19 05:05:38.862767 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 386/780] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:05:38 2021] GET /compute/v2.1/servers/f5e90100-1612-4e18-b86c-db90e3045760 => generated 1361 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 05:05:39.881289 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-e78fd7d9-86ed-4f9b-9dc3-38ab2948cf6b tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:05:39.881962 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-e78fd7d9-86ed-4f9b-9dc3-38ab2948cf6b tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] [instance: f5e90100-1612-4e18-b86c-db90e3045760] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:05:39.891816 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-e78fd7d9-86ed-4f9b-9dc3-38ab2948cf6b tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:05:39.892331 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-e78fd7d9-86ed-4f9b-9dc3-38ab2948cf6b tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:05:39.893187 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-e78fd7d9-86ed-4f9b-9dc3-38ab2948cf6b tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:05:39.893725 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-e78fd7d9-86ed-4f9b-9dc3-38ab2948cf6b tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:05:40.019171 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-c4b01396-c888-4fdf-a96c-50f63b8b65b7 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] 10.222.0.47 "POST /compute/v2.1/servers/dcb11872-0660-4e35-8d91-bfe80088844b/action" status: 200 len: 27743 microversion: 2.20 time: 2.275450 Feb 19 05:05:40.019941 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 395/781] 10.222.0.47 () {62 vars in 1309 bytes} [Fri Feb 19 05:05:37 2021] POST /compute/v2.1/servers/dcb11872-0660-4e35-8d91-bfe80088844b/action => generated 27743 bytes in 2277 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Feb 19 05:05:40.345710 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-e78fd7d9-86ed-4f9b-9dc3-38ab2948cf6b tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3274478c0a421895f43618dc827ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50941a0cab243e9a320ff22a7648de6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:05:40.355657 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-e78fd7d9-86ed-4f9b-9dc3-38ab2948cf6b tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] 10.222.0.47 "GET /compute/v2.1/servers/f5e90100-1612-4e18-b86c-db90e3045760" status: 200 len: 1361 microversion: 2.1 time: 0.478360 Feb 19 05:05:40.366511 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 387/782] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:05:39 2021] GET /compute/v2.1/servers/f5e90100-1612-4e18-b86c-db90e3045760 => generated 1361 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:05:41.038518 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-05019bbe-e72a-4478-afec-e932b514125d tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:05:41.040628 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-05019bbe-e72a-4478-afec-e932b514125d tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] [instance: dcb11872-0660-4e35-8d91-bfe80088844b] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:05:41.057093 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-05019bbe-e72a-4478-afec-e932b514125d tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:05:41.057995 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-05019bbe-e72a-4478-afec-e932b514125d tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:05:41.059544 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-05019bbe-e72a-4478-afec-e932b514125d tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:05:41.060420 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-05019bbe-e72a-4478-afec-e932b514125d tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:05:41.237967 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-05019bbe-e72a-4478-afec-e932b514125d tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] 10.222.0.47 "POST /compute/v2.1/servers/dcb11872-0660-4e35-8d91-bfe80088844b/action" status: 200 len: 28205 microversion: 2.20 time: 0.208929 Feb 19 05:05:41.239662 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 396/783] 10.222.0.47 () {62 vars in 1309 bytes} [Fri Feb 19 05:05:41 2021] POST /compute/v2.1/servers/dcb11872-0660-4e35-8d91-bfe80088844b/action => generated 28205 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 19 05:05:41.380520 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-27a90e73-61b7-4a93-b1bc-28473f861a57 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:05:41.381297 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-27a90e73-61b7-4a93-b1bc-28473f861a57 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] [instance: f5e90100-1612-4e18-b86c-db90e3045760] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:05:41.391684 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-27a90e73-61b7-4a93-b1bc-28473f861a57 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:05:41.392196 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-27a90e73-61b7-4a93-b1bc-28473f861a57 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:05:41.393067 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-27a90e73-61b7-4a93-b1bc-28473f861a57 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:05:41.393566 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-27a90e73-61b7-4a93-b1bc-28473f861a57 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:05:41.628669 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-27a90e73-61b7-4a93-b1bc-28473f861a57 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3274478c0a421895f43618dc827ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50941a0cab243e9a320ff22a7648de6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:05:41.638324 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-27a90e73-61b7-4a93-b1bc-28473f861a57 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] 10.222.0.47 "GET /compute/v2.1/servers/f5e90100-1612-4e18-b86c-db90e3045760" status: 200 len: 1361 microversion: 2.1 time: 0.266525 Feb 19 05:05:41.638969 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 388/784] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:05:41 2021] GET /compute/v2.1/servers/f5e90100-1612-4e18-b86c-db90e3045760 => generated 1361 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:05:42.252000 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-e1b30bb4-9d09-4373-a041-e9ecef6a3bcc tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:05:42.253277 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-e1b30bb4-9d09-4373-a041-e9ecef6a3bcc tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] [instance: dcb11872-0660-4e35-8d91-bfe80088844b] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:05:42.262148 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-e1b30bb4-9d09-4373-a041-e9ecef6a3bcc tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:05:42.262662 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-e1b30bb4-9d09-4373-a041-e9ecef6a3bcc tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:05:42.263566 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-e1b30bb4-9d09-4373-a041-e9ecef6a3bcc tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:05:42.264111 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-e1b30bb4-9d09-4373-a041-e9ecef6a3bcc tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:05:42.658098 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-1a4409e9-adb8-499a-a1d6-3b2d76f186be tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:05:42.658779 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-1a4409e9-adb8-499a-a1d6-3b2d76f186be tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] [instance: f5e90100-1612-4e18-b86c-db90e3045760] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:05:42.666904 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-1a4409e9-adb8-499a-a1d6-3b2d76f186be tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:05:42.667453 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-1a4409e9-adb8-499a-a1d6-3b2d76f186be tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:05:42.668309 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-1a4409e9-adb8-499a-a1d6-3b2d76f186be tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:05:42.668920 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-1a4409e9-adb8-499a-a1d6-3b2d76f186be tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:05:42.919148 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-1a4409e9-adb8-499a-a1d6-3b2d76f186be tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3274478c0a421895f43618dc827ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50941a0cab243e9a320ff22a7648de6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:05:42.929678 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-1a4409e9-adb8-499a-a1d6-3b2d76f186be tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] 10.222.0.47 "GET /compute/v2.1/servers/f5e90100-1612-4e18-b86c-db90e3045760" status: 200 len: 1361 microversion: 2.1 time: 0.276136 Feb 19 05:05:42.930337 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 389/785] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:05:42 2021] GET /compute/v2.1/servers/f5e90100-1612-4e18-b86c-db90e3045760 => generated 1361 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 05:05:43.952640 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-92cc4245-f891-4389-bff5-ab24a8202679 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:05:43.953303 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-92cc4245-f891-4389-bff5-ab24a8202679 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] [instance: f5e90100-1612-4e18-b86c-db90e3045760] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:05:43.961717 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-92cc4245-f891-4389-bff5-ab24a8202679 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:05:43.962223 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-92cc4245-f891-4389-bff5-ab24a8202679 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:05:43.963072 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-92cc4245-f891-4389-bff5-ab24a8202679 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:05:43.963588 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-92cc4245-f891-4389-bff5-ab24a8202679 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:05:44.204745 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-92cc4245-f891-4389-bff5-ab24a8202679 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3274478c0a421895f43618dc827ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50941a0cab243e9a320ff22a7648de6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:05:44.214794 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-92cc4245-f891-4389-bff5-ab24a8202679 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] 10.222.0.47 "GET /compute/v2.1/servers/f5e90100-1612-4e18-b86c-db90e3045760" status: 200 len: 1361 microversion: 2.1 time: 0.266119 Feb 19 05:05:44.215496 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 390/786] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:05:43 2021] GET /compute/v2.1/servers/f5e90100-1612-4e18-b86c-db90e3045760 => generated 1361 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:05:44.506156 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-e1b30bb4-9d09-4373-a041-e9ecef6a3bcc tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] 10.222.0.47 "POST /compute/v2.1/servers/dcb11872-0660-4e35-8d91-bfe80088844b/action" status: 200 len: 28205 microversion: 2.20 time: 2.259088 Feb 19 05:05:44.507389 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 397/787] 10.222.0.47 () {62 vars in 1309 bytes} [Fri Feb 19 05:05:42 2021] POST /compute/v2.1/servers/dcb11872-0660-4e35-8d91-bfe80088844b/action => generated 28205 bytes in 2262 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 19 05:05:45.235523 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-bebc5190-6228-49dd-9b40-ebfc5be8b00b tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:05:45.236279 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-bebc5190-6228-49dd-9b40-ebfc5be8b00b tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] [instance: f5e90100-1612-4e18-b86c-db90e3045760] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:05:45.245169 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-bebc5190-6228-49dd-9b40-ebfc5be8b00b tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:05:45.245765 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-bebc5190-6228-49dd-9b40-ebfc5be8b00b tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:05:45.246702 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-bebc5190-6228-49dd-9b40-ebfc5be8b00b tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:05:45.247294 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-bebc5190-6228-49dd-9b40-ebfc5be8b00b tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:05:45.495092 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-bebc5190-6228-49dd-9b40-ebfc5be8b00b tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3274478c0a421895f43618dc827ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50941a0cab243e9a320ff22a7648de6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:05:45.504682 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-bebc5190-6228-49dd-9b40-ebfc5be8b00b tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] 10.222.0.47 "GET /compute/v2.1/servers/f5e90100-1612-4e18-b86c-db90e3045760" status: 200 len: 1361 microversion: 2.1 time: 0.274693 Feb 19 05:05:45.505474 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 391/788] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:05:45 2021] GET /compute/v2.1/servers/f5e90100-1612-4e18-b86c-db90e3045760 => generated 1361 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:05:45.527591 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-43d6a61b-8b26-47fe-a20a-9d2c8aa16d3a tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:05:45.531105 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-43d6a61b-8b26-47fe-a20a-9d2c8aa16d3a tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] [instance: dcb11872-0660-4e35-8d91-bfe80088844b] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:05:45.553099 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-43d6a61b-8b26-47fe-a20a-9d2c8aa16d3a tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:05:45.554397 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-43d6a61b-8b26-47fe-a20a-9d2c8aa16d3a tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:05:45.556210 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-43d6a61b-8b26-47fe-a20a-9d2c8aa16d3a tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:05:45.557521 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-43d6a61b-8b26-47fe-a20a-9d2c8aa16d3a tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:05:45.708705 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-43d6a61b-8b26-47fe-a20a-9d2c8aa16d3a tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] 10.222.0.47 "POST /compute/v2.1/servers/dcb11872-0660-4e35-8d91-bfe80088844b/action" status: 200 len: 28205 microversion: 2.20 time: 0.190444 Feb 19 05:05:45.709447 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 398/789] 10.222.0.47 () {62 vars in 1309 bytes} [Fri Feb 19 05:05:45 2021] POST /compute/v2.1/servers/dcb11872-0660-4e35-8d91-bfe80088844b/action => generated 28205 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 19 05:05:46.526424 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-71247910-4615-4de7-9a82-1e9482054b4e tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:05:46.527132 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-71247910-4615-4de7-9a82-1e9482054b4e tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] [instance: f5e90100-1612-4e18-b86c-db90e3045760] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:05:46.539583 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-71247910-4615-4de7-9a82-1e9482054b4e tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:05:46.540779 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-71247910-4615-4de7-9a82-1e9482054b4e tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:05:46.542064 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-71247910-4615-4de7-9a82-1e9482054b4e tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:05:46.543256 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-71247910-4615-4de7-9a82-1e9482054b4e tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:05:46.729040 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-b1218f0a-5029-4e96-bb04-d75352f72a4c tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:05:46.731011 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-b1218f0a-5029-4e96-bb04-d75352f72a4c tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] [instance: dcb11872-0660-4e35-8d91-bfe80088844b] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:05:46.742600 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-b1218f0a-5029-4e96-bb04-d75352f72a4c tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:05:46.743114 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-b1218f0a-5029-4e96-bb04-d75352f72a4c tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:05:46.744381 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-b1218f0a-5029-4e96-bb04-d75352f72a4c tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:05:46.744876 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-b1218f0a-5029-4e96-bb04-d75352f72a4c tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:05:46.916078 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-b1218f0a-5029-4e96-bb04-d75352f72a4c tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] 10.222.0.47 "POST /compute/v2.1/servers/dcb11872-0660-4e35-8d91-bfe80088844b/action" status: 200 len: 28496 microversion: 2.20 time: 0.196417 Feb 19 05:05:46.921642 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 399/790] 10.222.0.47 () {62 vars in 1309 bytes} [Fri Feb 19 05:05:46 2021] POST /compute/v2.1/servers/dcb11872-0660-4e35-8d91-bfe80088844b/action => generated 28496 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 19 05:05:47.066519 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-71247910-4615-4de7-9a82-1e9482054b4e tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3274478c0a421895f43618dc827ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50941a0cab243e9a320ff22a7648de6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:05:47.076044 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-71247910-4615-4de7-9a82-1e9482054b4e tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] 10.222.0.47 "GET /compute/v2.1/servers/f5e90100-1612-4e18-b86c-db90e3045760" status: 200 len: 1361 microversion: 2.1 time: 0.553640 Feb 19 05:05:47.076810 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 392/791] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:05:46 2021] GET /compute/v2.1/servers/f5e90100-1612-4e18-b86c-db90e3045760 => generated 1361 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:05:47.943981 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-be772fac-ef2f-46b8-adfc-6a97187aceea tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:05:47.956260 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-be772fac-ef2f-46b8-adfc-6a97187aceea tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] [instance: dcb11872-0660-4e35-8d91-bfe80088844b] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:05:47.970246 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-be772fac-ef2f-46b8-adfc-6a97187aceea tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:05:47.971148 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-be772fac-ef2f-46b8-adfc-6a97187aceea tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:05:47.972215 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-be772fac-ef2f-46b8-adfc-6a97187aceea tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:05:47.973229 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-be772fac-ef2f-46b8-adfc-6a97187aceea tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:05:48.100237 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-82ad1d13-7639-4df8-9ef6-44632f2e6f55 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:05:48.101922 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-82ad1d13-7639-4df8-9ef6-44632f2e6f55 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] [instance: f5e90100-1612-4e18-b86c-db90e3045760] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:05:48.111411 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-82ad1d13-7639-4df8-9ef6-44632f2e6f55 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:05:48.112059 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-82ad1d13-7639-4df8-9ef6-44632f2e6f55 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:05:48.113030 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-82ad1d13-7639-4df8-9ef6-44632f2e6f55 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:05:48.113614 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-82ad1d13-7639-4df8-9ef6-44632f2e6f55 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:05:48.134571 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-be772fac-ef2f-46b8-adfc-6a97187aceea tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] 10.222.0.47 "POST /compute/v2.1/servers/dcb11872-0660-4e35-8d91-bfe80088844b/action" status: 200 len: 28664 microversion: 2.20 time: 0.207106 Feb 19 05:05:48.135764 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 400/792] 10.222.0.47 () {62 vars in 1309 bytes} [Fri Feb 19 05:05:47 2021] POST /compute/v2.1/servers/dcb11872-0660-4e35-8d91-bfe80088844b/action => generated 28664 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 19 05:05:48.671954 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-82ad1d13-7639-4df8-9ef6-44632f2e6f55 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3274478c0a421895f43618dc827ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50941a0cab243e9a320ff22a7648de6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:05:48.692263 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-82ad1d13-7639-4df8-9ef6-44632f2e6f55 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] 10.222.0.47 "GET /compute/v2.1/servers/f5e90100-1612-4e18-b86c-db90e3045760" status: 200 len: 1361 microversion: 2.1 time: 0.597250 Feb 19 05:05:48.693973 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 393/793] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:05:48 2021] GET /compute/v2.1/servers/f5e90100-1612-4e18-b86c-db90e3045760 => generated 1361 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 05:05:48.836779 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [req-a83e6411-80b5-40a2-ba67-86773ed60cf2 req-3311f135-3e07-4769-a103-7dfcdc27dbc5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5e90100-1612-4e18-b86c-db90e3045760", "name": "network-vif-plugged", "status": "completed", "tag": "e40bbdec-f58a-4faa-a0b4-30939473013f"}]} {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:05:48.839607 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 05:05:48.839607 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: warnings.warn(msg) Feb 19 05:05:48.849913 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [req-a83e6411-80b5-40a2-ba67-86773ed60cf2 req-3311f135-3e07-4769-a103-7dfcdc27dbc5 service nova] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:05:48.850505 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [req-a83e6411-80b5-40a2-ba67-86773ed60cf2 req-3311f135-3e07-4769-a103-7dfcdc27dbc5 service nova] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:05:48.874473 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.compute.server_external_events [req-a83e6411-80b5-40a2-ba67-86773ed60cf2 req-3311f135-3e07-4769-a103-7dfcdc27dbc5 service nova] Creating event network-vif-plugged:e40bbdec-f58a-4faa-a0b4-30939473013f for instance f5e90100-1612-4e18-b86c-db90e3045760 on hv-cinder-77642 Feb 19 05:05:48.880184 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [req-a83e6411-80b5-40a2-ba67-86773ed60cf2 req-3311f135-3e07-4769-a103-7dfcdc27dbc5 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.357065 Feb 19 05:05:48.880950 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 401/794] 10.222.0.47 () {64 vars in 1308 bytes} [Fri Feb 19 05:05:48 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 05:05:49.149840 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-e1d0f3bf-23f5-4a46-a95f-47656279ec5f tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:05:49.156893 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-e1d0f3bf-23f5-4a46-a95f-47656279ec5f tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] [instance: dcb11872-0660-4e35-8d91-bfe80088844b] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:05:49.161514 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-e1d0f3bf-23f5-4a46-a95f-47656279ec5f tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:05:49.162101 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-e1d0f3bf-23f5-4a46-a95f-47656279ec5f tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:05:49.163049 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-e1d0f3bf-23f5-4a46-a95f-47656279ec5f tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:05:49.163643 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-e1d0f3bf-23f5-4a46-a95f-47656279ec5f tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:05:49.304321 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-e1d0f3bf-23f5-4a46-a95f-47656279ec5f tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] 10.222.0.47 "POST /compute/v2.1/servers/dcb11872-0660-4e35-8d91-bfe80088844b/action" status: 200 len: 28664 microversion: 2.20 time: 0.158103 Feb 19 05:05:49.305979 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 394/795] 10.222.0.47 () {62 vars in 1309 bytes} [Fri Feb 19 05:05:49 2021] POST /compute/v2.1/servers/dcb11872-0660-4e35-8d91-bfe80088844b/action => generated 28664 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 19 05:05:49.726282 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-590cf14e-45dc-46d2-8d5c-114a9acec719 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:05:49.727216 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-590cf14e-45dc-46d2-8d5c-114a9acec719 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] [instance: f5e90100-1612-4e18-b86c-db90e3045760] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:05:49.738413 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-590cf14e-45dc-46d2-8d5c-114a9acec719 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:05:49.738913 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-590cf14e-45dc-46d2-8d5c-114a9acec719 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:05:49.739779 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-590cf14e-45dc-46d2-8d5c-114a9acec719 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:05:49.740269 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-590cf14e-45dc-46d2-8d5c-114a9acec719 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:05:50.319899 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-b39d5198-1edc-4ac3-bcbb-63e95f853ffc tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:05:50.321186 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-b39d5198-1edc-4ac3-bcbb-63e95f853ffc tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] [instance: dcb11872-0660-4e35-8d91-bfe80088844b] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:05:50.330860 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-b39d5198-1edc-4ac3-bcbb-63e95f853ffc tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:05:50.331368 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-b39d5198-1edc-4ac3-bcbb-63e95f853ffc tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:05:50.332440 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-b39d5198-1edc-4ac3-bcbb-63e95f853ffc tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:05:50.333129 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-b39d5198-1edc-4ac3-bcbb-63e95f853ffc tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:05:50.521498 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-b39d5198-1edc-4ac3-bcbb-63e95f853ffc tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] 10.222.0.47 "POST /compute/v2.1/servers/dcb11872-0660-4e35-8d91-bfe80088844b/action" status: 200 len: 28664 microversion: 2.20 time: 0.205554 Feb 19 05:05:50.522919 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 395/796] 10.222.0.47 () {62 vars in 1309 bytes} [Fri Feb 19 05:05:50 2021] POST /compute/v2.1/servers/dcb11872-0660-4e35-8d91-bfe80088844b/action => generated 28664 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Feb 19 05:05:50.542470 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-590cf14e-45dc-46d2-8d5c-114a9acec719 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3274478c0a421895f43618dc827ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50941a0cab243e9a320ff22a7648de6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:05:50.560212 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-590cf14e-45dc-46d2-8d5c-114a9acec719 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] 10.222.0.47 "GET /compute/v2.1/servers/f5e90100-1612-4e18-b86c-db90e3045760" status: 200 len: 1361 microversion: 2.1 time: 0.841901 Feb 19 05:05:50.562368 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 402/797] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:05:49 2021] GET /compute/v2.1/servers/f5e90100-1612-4e18-b86c-db90e3045760 => generated 1361 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:05:51.542700 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-27fd6ecd-810e-461f-8867-9c514329f1b2 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:05:51.545594 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-27fd6ecd-810e-461f-8867-9c514329f1b2 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] [instance: dcb11872-0660-4e35-8d91-bfe80088844b] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:05:51.565662 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-27fd6ecd-810e-461f-8867-9c514329f1b2 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:05:51.566615 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-27fd6ecd-810e-461f-8867-9c514329f1b2 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:05:51.568331 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-27fd6ecd-810e-461f-8867-9c514329f1b2 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:05:51.569306 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-27fd6ecd-810e-461f-8867-9c514329f1b2 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:05:51.599281 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-63ed1b24-05d5-4566-a9e0-a11c1bda963d tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:05:51.601412 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-63ed1b24-05d5-4566-a9e0-a11c1bda963d tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] [instance: f5e90100-1612-4e18-b86c-db90e3045760] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:05:51.620926 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-63ed1b24-05d5-4566-a9e0-a11c1bda963d tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:05:51.622330 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-63ed1b24-05d5-4566-a9e0-a11c1bda963d tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:05:51.625163 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-63ed1b24-05d5-4566-a9e0-a11c1bda963d tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:05:51.626844 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-63ed1b24-05d5-4566-a9e0-a11c1bda963d tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:05:51.818110 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-27fd6ecd-810e-461f-8867-9c514329f1b2 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] 10.222.0.47 "POST /compute/v2.1/servers/dcb11872-0660-4e35-8d91-bfe80088844b/action" status: 200 len: 28664 microversion: 2.20 time: 0.285503 Feb 19 05:05:51.818846 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 396/798] 10.222.0.47 () {62 vars in 1309 bytes} [Fri Feb 19 05:05:51 2021] POST /compute/v2.1/servers/dcb11872-0660-4e35-8d91-bfe80088844b/action => generated 28664 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 19 05:05:52.449109 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-63ed1b24-05d5-4566-a9e0-a11c1bda963d tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3274478c0a421895f43618dc827ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50941a0cab243e9a320ff22a7648de6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:05:52.470483 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-63ed1b24-05d5-4566-a9e0-a11c1bda963d tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] 10.222.0.47 "GET /compute/v2.1/servers/f5e90100-1612-4e18-b86c-db90e3045760" status: 200 len: 1548 microversion: 2.1 time: 0.880077 Feb 19 05:05:52.472258 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 403/799] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:05:51 2021] GET /compute/v2.1/servers/f5e90100-1612-4e18-b86c-db90e3045760 => generated 1548 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:05:52.514658 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-bcc3bde1-60cf-4bd4-8857-bf2557002e3d tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:05:52.517107 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-bcc3bde1-60cf-4bd4-8857-bf2557002e3d tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] [instance: f5e90100-1612-4e18-b86c-db90e3045760] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:05:52.551816 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-bcc3bde1-60cf-4bd4-8857-bf2557002e3d tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:05:52.554382 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-bcc3bde1-60cf-4bd4-8857-bf2557002e3d tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:05:52.556398 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-bcc3bde1-60cf-4bd4-8857-bf2557002e3d tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:05:52.557662 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-bcc3bde1-60cf-4bd4-8857-bf2557002e3d tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:05:52.840721 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-2383f0b0-5642-4043-9d74-772331333159 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:05:52.843794 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-2383f0b0-5642-4043-9d74-772331333159 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] [instance: dcb11872-0660-4e35-8d91-bfe80088844b] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:05:52.862625 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-2383f0b0-5642-4043-9d74-772331333159 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:05:52.864004 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-2383f0b0-5642-4043-9d74-772331333159 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:05:52.866553 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-2383f0b0-5642-4043-9d74-772331333159 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:05:52.868274 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-2383f0b0-5642-4043-9d74-772331333159 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:05:53.112034 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-2383f0b0-5642-4043-9d74-772331333159 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] 10.222.0.47 "POST /compute/v2.1/servers/dcb11872-0660-4e35-8d91-bfe80088844b/action" status: 200 len: 29669 microversion: 2.20 time: 0.279078 Feb 19 05:05:53.113633 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 404/800] 10.222.0.47 () {62 vars in 1309 bytes} [Fri Feb 19 05:05:52 2021] POST /compute/v2.1/servers/dcb11872-0660-4e35-8d91-bfe80088844b/action => generated 29669 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Feb 19 05:05:53.359625 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-bcc3bde1-60cf-4bd4-8857-bf2557002e3d tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] 10.222.0.47 "GET /compute/v2.1/servers/f5e90100-1612-4e18-b86c-db90e3045760/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.871504 Feb 19 05:05:53.367622 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 397/801] 10.222.0.47 () {58 vars in 1265 bytes} [Fri Feb 19 05:05:52 2021] GET /compute/v2.1/servers/f5e90100-1612-4e18-b86c-db90e3045760/os-interface => generated 285 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 05:05:54.135221 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-c4aefb8d-71e8-4e1d-bc63-33ad24330ef2 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:05:54.138861 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-c4aefb8d-71e8-4e1d-bc63-33ad24330ef2 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] [instance: dcb11872-0660-4e35-8d91-bfe80088844b] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:05:54.160607 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-c4aefb8d-71e8-4e1d-bc63-33ad24330ef2 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:05:54.162012 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-c4aefb8d-71e8-4e1d-bc63-33ad24330ef2 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:05:54.164406 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-c4aefb8d-71e8-4e1d-bc63-33ad24330ef2 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:05:54.165726 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-c4aefb8d-71e8-4e1d-bc63-33ad24330ef2 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:05:54.433119 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-c4aefb8d-71e8-4e1d-bc63-33ad24330ef2 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] 10.222.0.47 "POST /compute/v2.1/servers/dcb11872-0660-4e35-8d91-bfe80088844b/action" status: 200 len: 32071 microversion: 2.20 time: 0.307961 Feb 19 05:05:54.444535 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 405/802] 10.222.0.47 () {62 vars in 1309 bytes} [Fri Feb 19 05:05:54 2021] POST /compute/v2.1/servers/dcb11872-0660-4e35-8d91-bfe80088844b/action => generated 32071 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 19 05:05:55.456046 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-58e509f2-4e11-4f80-abe1-23b16053385b tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:05:55.456998 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-58e509f2-4e11-4f80-abe1-23b16053385b tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] [instance: dcb11872-0660-4e35-8d91-bfe80088844b] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:05:55.477689 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-58e509f2-4e11-4f80-abe1-23b16053385b tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:05:55.478258 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-58e509f2-4e11-4f80-abe1-23b16053385b tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:05:55.479382 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-58e509f2-4e11-4f80-abe1-23b16053385b tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:05:55.479900 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-58e509f2-4e11-4f80-abe1-23b16053385b tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:05:55.685156 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-58e509f2-4e11-4f80-abe1-23b16053385b tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] 10.222.0.47 "POST /compute/v2.1/servers/dcb11872-0660-4e35-8d91-bfe80088844b/action" status: 200 len: 33520 microversion: 2.20 time: 0.235416 Feb 19 05:05:55.687831 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 398/803] 10.222.0.47 () {62 vars in 1309 bytes} [Fri Feb 19 05:05:55 2021] POST /compute/v2.1/servers/dcb11872-0660-4e35-8d91-bfe80088844b/action => generated 33520 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 19 05:05:56.228508 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-f83f3fc9-a3a3-45f2-af4e-5ff9a0e3bfcb tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:05:56.237107 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [req-a877de77-911c-4e86-82d6-55bafaea6419 req-5a237f4a-42da-4c32-84c6-417bb8e15fda service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f5e90100-1612-4e18-b86c-db90e3045760", "tag": "e40bbdec-f58a-4faa-a0b4-30939473013f"}]} {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:05:56.238495 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-f83f3fc9-a3a3-45f2-af4e-5ff9a0e3bfcb tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] [instance: f5e90100-1612-4e18-b86c-db90e3045760] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:05:56.244257 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 05:05:56.244257 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: warnings.warn(msg) Feb 19 05:05:56.278282 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-f83f3fc9-a3a3-45f2-af4e-5ff9a0e3bfcb tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:05:56.279242 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-f83f3fc9-a3a3-45f2-af4e-5ff9a0e3bfcb tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:05:56.281513 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-f83f3fc9-a3a3-45f2-af4e-5ff9a0e3bfcb tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:05:56.282432 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-f83f3fc9-a3a3-45f2-af4e-5ff9a0e3bfcb tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:05:56.288318 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [req-a877de77-911c-4e86-82d6-55bafaea6419 req-5a237f4a-42da-4c32-84c6-417bb8e15fda service nova] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:05:56.289248 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [req-a877de77-911c-4e86-82d6-55bafaea6419 req-5a237f4a-42da-4c32-84c6-417bb8e15fda service nova] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:05:56.324920 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.compute.server_external_events [req-a877de77-911c-4e86-82d6-55bafaea6419 req-5a237f4a-42da-4c32-84c6-417bb8e15fda service nova] Creating event network-changed:e40bbdec-f58a-4faa-a0b4-30939473013f for instance f5e90100-1612-4e18-b86c-db90e3045760 on hv-cinder-77642 Feb 19 05:05:56.335289 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [req-a877de77-911c-4e86-82d6-55bafaea6419 req-5a237f4a-42da-4c32-84c6-417bb8e15fda service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115368 Feb 19 05:05:56.336770 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 399/804] 10.222.0.47 () {64 vars in 1308 bytes} [Fri Feb 19 05:05:56 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 05:05:56.498122 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-f83f3fc9-a3a3-45f2-af4e-5ff9a0e3bfcb tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] 10.222.0.47 "POST /compute/v2.1/servers/f5e90100-1612-4e18-b86c-db90e3045760/action" status: 200 len: 14 microversion: 2.1 time: 0.286557 Feb 19 05:05:56.499538 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 406/805] 10.222.0.47 () {60 vars in 1268 bytes} [Fri Feb 19 05:05:56 2021] POST /compute/v2.1/servers/f5e90100-1612-4e18-b86c-db90e3045760/action => generated 14 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 19 05:05:56.704035 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-61768c5f-42d5-44fe-9cbe-b89fb38ac437 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:05:56.705355 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-61768c5f-42d5-44fe-9cbe-b89fb38ac437 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] [instance: dcb11872-0660-4e35-8d91-bfe80088844b] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:05:56.723726 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-61768c5f-42d5-44fe-9cbe-b89fb38ac437 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:05:56.725233 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-61768c5f-42d5-44fe-9cbe-b89fb38ac437 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:05:56.736506 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-61768c5f-42d5-44fe-9cbe-b89fb38ac437 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:05:56.737217 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-61768c5f-42d5-44fe-9cbe-b89fb38ac437 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:05:57.016221 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-61768c5f-42d5-44fe-9cbe-b89fb38ac437 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] 10.222.0.47 "POST /compute/v2.1/servers/dcb11872-0660-4e35-8d91-bfe80088844b/action" status: 200 len: 34710 microversion: 2.20 time: 0.315823 Feb 19 05:05:57.024193 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 400/806] 10.222.0.47 () {62 vars in 1309 bytes} [Fri Feb 19 05:05:56 2021] POST /compute/v2.1/servers/dcb11872-0660-4e35-8d91-bfe80088844b/action => generated 34710 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Feb 19 05:05:57.516213 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-3cef1e49-00e3-4cc7-9794-588af95b2af6 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:05:57.517647 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-3cef1e49-00e3-4cc7-9794-588af95b2af6 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] [instance: f5e90100-1612-4e18-b86c-db90e3045760] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:05:57.554051 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-3cef1e49-00e3-4cc7-9794-588af95b2af6 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:05:57.556973 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-3cef1e49-00e3-4cc7-9794-588af95b2af6 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:05:57.562556 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-3cef1e49-00e3-4cc7-9794-588af95b2af6 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:05:57.563882 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-3cef1e49-00e3-4cc7-9794-588af95b2af6 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:05:57.836891 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-3cef1e49-00e3-4cc7-9794-588af95b2af6 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] 10.222.0.47 "POST /compute/v2.1/servers/f5e90100-1612-4e18-b86c-db90e3045760/action" status: 200 len: 14 microversion: 2.1 time: 0.326946 Feb 19 05:05:57.837747 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 407/807] 10.222.0.47 () {60 vars in 1268 bytes} [Fri Feb 19 05:05:57 2021] POST /compute/v2.1/servers/f5e90100-1612-4e18-b86c-db90e3045760/action => generated 14 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 19 05:05:58.033239 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-c3db39b5-5f92-44a6-8654-08c1306422d7 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:05:58.034776 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-c3db39b5-5f92-44a6-8654-08c1306422d7 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] [instance: dcb11872-0660-4e35-8d91-bfe80088844b] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:05:58.044755 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-c3db39b5-5f92-44a6-8654-08c1306422d7 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:05:58.046008 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-c3db39b5-5f92-44a6-8654-08c1306422d7 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:05:58.047420 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-c3db39b5-5f92-44a6-8654-08c1306422d7 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:05:58.048228 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-c3db39b5-5f92-44a6-8654-08c1306422d7 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:05:58.229269 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-c3db39b5-5f92-44a6-8654-08c1306422d7 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] 10.222.0.47 "POST /compute/v2.1/servers/dcb11872-0660-4e35-8d91-bfe80088844b/action" status: 200 len: 35652 microversion: 2.20 time: 0.201224 Feb 19 05:05:58.236673 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 401/808] 10.222.0.47 () {62 vars in 1309 bytes} [Fri Feb 19 05:05:58 2021] POST /compute/v2.1/servers/dcb11872-0660-4e35-8d91-bfe80088844b/action => generated 35652 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 19 05:05:58.856946 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-c3888884-bc0f-4b45-bf1b-176e7fa078e8 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:05:58.862522 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-c3888884-bc0f-4b45-bf1b-176e7fa078e8 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] [instance: f5e90100-1612-4e18-b86c-db90e3045760] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:05:58.883760 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-c3888884-bc0f-4b45-bf1b-176e7fa078e8 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:05:58.885881 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-c3888884-bc0f-4b45-bf1b-176e7fa078e8 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:05:58.888366 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-c3888884-bc0f-4b45-bf1b-176e7fa078e8 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:05:58.892062 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-c3888884-bc0f-4b45-bf1b-176e7fa078e8 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:05:59.194975 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-c3888884-bc0f-4b45-bf1b-176e7fa078e8 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] 10.222.0.47 "POST /compute/v2.1/servers/f5e90100-1612-4e18-b86c-db90e3045760/action" status: 200 len: 14 microversion: 2.1 time: 0.347578 Feb 19 05:05:59.196274 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 408/809] 10.222.0.47 () {60 vars in 1268 bytes} [Fri Feb 19 05:05:58 2021] POST /compute/v2.1/servers/f5e90100-1612-4e18-b86c-db90e3045760/action => generated 14 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 19 05:05:59.253301 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-d754ebdb-6e88-4391-91a2-67fe5b498d3d tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:05:59.255531 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-d754ebdb-6e88-4391-91a2-67fe5b498d3d tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] [instance: dcb11872-0660-4e35-8d91-bfe80088844b] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:05:59.278580 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-d754ebdb-6e88-4391-91a2-67fe5b498d3d tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:05:59.280485 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-d754ebdb-6e88-4391-91a2-67fe5b498d3d tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:05:59.282245 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-d754ebdb-6e88-4391-91a2-67fe5b498d3d tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:05:59.284035 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-d754ebdb-6e88-4391-91a2-67fe5b498d3d tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:05:59.504299 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-d754ebdb-6e88-4391-91a2-67fe5b498d3d tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] 10.222.0.47 "POST /compute/v2.1/servers/dcb11872-0660-4e35-8d91-bfe80088844b/action" status: 200 len: 37374 microversion: 2.20 time: 0.261156 Feb 19 05:05:59.506023 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 402/810] 10.222.0.47 () {62 vars in 1309 bytes} [Fri Feb 19 05:05:59 2021] POST /compute/v2.1/servers/dcb11872-0660-4e35-8d91-bfe80088844b/action => generated 37374 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 19 05:06:00.216540 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-4d6381cd-224e-46ba-9ecd-0d1c30dd37d4 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:06:00.219477 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-4d6381cd-224e-46ba-9ecd-0d1c30dd37d4 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] [instance: f5e90100-1612-4e18-b86c-db90e3045760] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:06:00.238004 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-4d6381cd-224e-46ba-9ecd-0d1c30dd37d4 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:06:00.238977 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-4d6381cd-224e-46ba-9ecd-0d1c30dd37d4 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:06:00.240593 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-4d6381cd-224e-46ba-9ecd-0d1c30dd37d4 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:06:00.241916 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-4d6381cd-224e-46ba-9ecd-0d1c30dd37d4 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:06:00.437452 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-4d6381cd-224e-46ba-9ecd-0d1c30dd37d4 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] 10.222.0.47 "POST /compute/v2.1/servers/f5e90100-1612-4e18-b86c-db90e3045760/action" status: 200 len: 14 microversion: 2.1 time: 0.229752 Feb 19 05:06:00.442716 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 409/811] 10.222.0.47 () {60 vars in 1268 bytes} [Fri Feb 19 05:06:00 2021] POST /compute/v2.1/servers/f5e90100-1612-4e18-b86c-db90e3045760/action => generated 14 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 19 05:06:00.522618 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-066cd291-ee7f-4b18-a990-7522a35dc05e tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:06:00.524133 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-066cd291-ee7f-4b18-a990-7522a35dc05e tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] [instance: dcb11872-0660-4e35-8d91-bfe80088844b] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:06:00.537110 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-066cd291-ee7f-4b18-a990-7522a35dc05e tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:06:00.537945 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-066cd291-ee7f-4b18-a990-7522a35dc05e tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:06:00.539093 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-066cd291-ee7f-4b18-a990-7522a35dc05e tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:06:00.539880 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-066cd291-ee7f-4b18-a990-7522a35dc05e tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:06:00.703194 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-066cd291-ee7f-4b18-a990-7522a35dc05e tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] 10.222.0.47 "POST /compute/v2.1/servers/dcb11872-0660-4e35-8d91-bfe80088844b/action" status: 200 len: 38217 microversion: 2.20 time: 0.173163 Feb 19 05:06:00.704234 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 403/812] 10.222.0.47 () {62 vars in 1309 bytes} [Fri Feb 19 05:06:00 2021] POST /compute/v2.1/servers/dcb11872-0660-4e35-8d91-bfe80088844b/action => generated 38217 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 19 05:06:01.453956 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-f39f60b0-d926-4e13-a99f-bd667e65a0cc tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:06:01.457005 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-f39f60b0-d926-4e13-a99f-bd667e65a0cc tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] [instance: f5e90100-1612-4e18-b86c-db90e3045760] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:06:01.469516 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-f39f60b0-d926-4e13-a99f-bd667e65a0cc tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:06:01.470562 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-f39f60b0-d926-4e13-a99f-bd667e65a0cc tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:06:01.471998 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-f39f60b0-d926-4e13-a99f-bd667e65a0cc tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:06:01.472803 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-f39f60b0-d926-4e13-a99f-bd667e65a0cc tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:06:01.628373 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-f39f60b0-d926-4e13-a99f-bd667e65a0cc tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] 10.222.0.47 "POST /compute/v2.1/servers/f5e90100-1612-4e18-b86c-db90e3045760/action" status: 200 len: 14 microversion: 2.1 time: 0.179497 Feb 19 05:06:01.629539 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 410/813] 10.222.0.47 () {60 vars in 1268 bytes} [Fri Feb 19 05:06:01 2021] POST /compute/v2.1/servers/f5e90100-1612-4e18-b86c-db90e3045760/action => generated 14 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 19 05:06:01.722709 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-d0d049ff-d1db-4771-84b6-8e83e11437ab tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:06:01.723873 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-d0d049ff-d1db-4771-84b6-8e83e11437ab tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] [instance: dcb11872-0660-4e35-8d91-bfe80088844b] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:06:01.734913 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-d0d049ff-d1db-4771-84b6-8e83e11437ab tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:06:01.735749 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-d0d049ff-d1db-4771-84b6-8e83e11437ab tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:06:01.736781 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-d0d049ff-d1db-4771-84b6-8e83e11437ab tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:06:01.737740 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-d0d049ff-d1db-4771-84b6-8e83e11437ab tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:06:01.895055 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-d0d049ff-d1db-4771-84b6-8e83e11437ab tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] 10.222.0.47 "POST /compute/v2.1/servers/dcb11872-0660-4e35-8d91-bfe80088844b/action" status: 200 len: 38217 microversion: 2.20 time: 0.178380 Feb 19 05:06:01.896225 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 404/814] 10.222.0.47 () {62 vars in 1309 bytes} [Fri Feb 19 05:06:01 2021] POST /compute/v2.1/servers/dcb11872-0660-4e35-8d91-bfe80088844b/action => generated 38217 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Feb 19 05:06:02.646075 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-f20787d3-a6e8-42ba-b0b4-87ee0ee3f179 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:06:02.647653 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-f20787d3-a6e8-42ba-b0b4-87ee0ee3f179 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] [instance: f5e90100-1612-4e18-b86c-db90e3045760] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:06:02.660698 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-f20787d3-a6e8-42ba-b0b4-87ee0ee3f179 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:06:02.662790 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-f20787d3-a6e8-42ba-b0b4-87ee0ee3f179 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:06:02.664281 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-f20787d3-a6e8-42ba-b0b4-87ee0ee3f179 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:06:02.665107 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-f20787d3-a6e8-42ba-b0b4-87ee0ee3f179 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:06:02.806705 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-f20787d3-a6e8-42ba-b0b4-87ee0ee3f179 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] 10.222.0.47 "POST /compute/v2.1/servers/f5e90100-1612-4e18-b86c-db90e3045760/action" status: 200 len: 14 microversion: 2.1 time: 0.167791 Feb 19 05:06:02.810326 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 411/815] 10.222.0.47 () {60 vars in 1268 bytes} [Fri Feb 19 05:06:02 2021] POST /compute/v2.1/servers/f5e90100-1612-4e18-b86c-db90e3045760/action => generated 14 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 19 05:06:02.922474 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-cb547254-7a9d-4a14-8bcc-e01036428b22 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:06:02.923798 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-cb547254-7a9d-4a14-8bcc-e01036428b22 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] [instance: dcb11872-0660-4e35-8d91-bfe80088844b] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:06:02.942484 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-cb547254-7a9d-4a14-8bcc-e01036428b22 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:06:02.943410 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-cb547254-7a9d-4a14-8bcc-e01036428b22 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:06:02.944492 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-cb547254-7a9d-4a14-8bcc-e01036428b22 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:06:02.945533 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-cb547254-7a9d-4a14-8bcc-e01036428b22 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:06:03.210297 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-cb547254-7a9d-4a14-8bcc-e01036428b22 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] 10.222.0.47 "POST /compute/v2.1/servers/dcb11872-0660-4e35-8d91-bfe80088844b/action" status: 200 len: 38217 microversion: 2.20 time: 0.302156 Feb 19 05:06:03.211136 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 405/816] 10.222.0.47 () {62 vars in 1309 bytes} [Fri Feb 19 05:06:02 2021] POST /compute/v2.1/servers/dcb11872-0660-4e35-8d91-bfe80088844b/action => generated 38217 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 19 05:06:03.819467 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-3414ab92-2121-4b19-b714-2ba2e0ff9ea8 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:06:03.820750 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-3414ab92-2121-4b19-b714-2ba2e0ff9ea8 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] [instance: f5e90100-1612-4e18-b86c-db90e3045760] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:06:03.830469 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-3414ab92-2121-4b19-b714-2ba2e0ff9ea8 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:06:03.831224 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-3414ab92-2121-4b19-b714-2ba2e0ff9ea8 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:06:03.832289 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-3414ab92-2121-4b19-b714-2ba2e0ff9ea8 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:06:03.832940 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-3414ab92-2121-4b19-b714-2ba2e0ff9ea8 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:06:03.977039 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-3414ab92-2121-4b19-b714-2ba2e0ff9ea8 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] 10.222.0.47 "POST /compute/v2.1/servers/f5e90100-1612-4e18-b86c-db90e3045760/action" status: 200 len: 1472 microversion: 2.1 time: 0.162081 Feb 19 05:06:03.978194 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 412/817] 10.222.0.47 () {60 vars in 1268 bytes} [Fri Feb 19 05:06:03 2021] POST /compute/v2.1/servers/f5e90100-1612-4e18-b86c-db90e3045760/action => generated 1472 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:06:04.224473 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-9faed414-2e46-449d-bf00-a762892aae4b tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:06:04.226013 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-9faed414-2e46-449d-bf00-a762892aae4b tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] [instance: dcb11872-0660-4e35-8d91-bfe80088844b] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:06:04.235896 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-9faed414-2e46-449d-bf00-a762892aae4b tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:06:04.236821 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-9faed414-2e46-449d-bf00-a762892aae4b tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:06:04.237895 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-9faed414-2e46-449d-bf00-a762892aae4b tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:06:04.238598 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-9faed414-2e46-449d-bf00-a762892aae4b tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:06:04.376385 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-9faed414-2e46-449d-bf00-a762892aae4b tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] 10.222.0.47 "POST /compute/v2.1/servers/dcb11872-0660-4e35-8d91-bfe80088844b/action" status: 200 len: 38358 microversion: 2.20 time: 0.155283 Feb 19 05:06:04.377938 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 406/818] 10.222.0.47 () {62 vars in 1309 bytes} [Fri Feb 19 05:06:04 2021] POST /compute/v2.1/servers/dcb11872-0660-4e35-8d91-bfe80088844b/action => generated 38358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 19 05:06:04.390219 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-7195627e-f0de-4f4a-807a-e3b61f339600 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:06:04.391730 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-7195627e-f0de-4f4a-807a-e3b61f339600 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] [instance: dcb11872-0660-4e35-8d91-bfe80088844b] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:06:04.402930 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-7195627e-f0de-4f4a-807a-e3b61f339600 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:06:04.403578 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-7195627e-f0de-4f4a-807a-e3b61f339600 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:06:04.405088 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-7195627e-f0de-4f4a-807a-e3b61f339600 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:06:04.405212 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-7195627e-f0de-4f4a-807a-e3b61f339600 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:06:04.490860 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-7195627e-f0de-4f4a-807a-e3b61f339600 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] 10.222.0.47 "GET /compute/v2.1/servers/dcb11872-0660-4e35-8d91-bfe80088844b/ips" status: 200 len: 152 microversion: 2.20 time: 0.106693 Feb 19 05:06:04.491566 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 413/819] 10.222.0.47 () {60 vars in 1279 bytes} [Fri Feb 19 05:06:04 2021] GET /compute/v2.1/servers/dcb11872-0660-4e35-8d91-bfe80088844b/ips => generated 152 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 19 05:06:04.992519 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-ca3a9f81-c952-4d9f-ac9d-33ea6ccfb270 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:06:04.994212 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-ca3a9f81-c952-4d9f-ac9d-33ea6ccfb270 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] [instance: f5e90100-1612-4e18-b86c-db90e3045760] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:06:05.025579 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-ca3a9f81-c952-4d9f-ac9d-33ea6ccfb270 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:06:05.026099 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-ca3a9f81-c952-4d9f-ac9d-33ea6ccfb270 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:06:05.027047 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-ca3a9f81-c952-4d9f-ac9d-33ea6ccfb270 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:06:05.027519 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-ca3a9f81-c952-4d9f-ac9d-33ea6ccfb270 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:06:05.206903 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-ca3a9f81-c952-4d9f-ac9d-33ea6ccfb270 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] 10.222.0.47 "POST /compute/v2.1/servers/f5e90100-1612-4e18-b86c-db90e3045760/action" status: 200 len: 14250 microversion: 2.1 time: 0.218985 Feb 19 05:06:05.207967 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 407/820] 10.222.0.47 () {60 vars in 1268 bytes} [Fri Feb 19 05:06:04 2021] POST /compute/v2.1/servers/f5e90100-1612-4e18-b86c-db90e3045760/action => generated 14250 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 19 05:06:06.221636 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-83e28856-dbfc-471a-908d-2fab9903a451 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:06:06.222744 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-83e28856-dbfc-471a-908d-2fab9903a451 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] [instance: f5e90100-1612-4e18-b86c-db90e3045760] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:06:06.245496 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-83e28856-dbfc-471a-908d-2fab9903a451 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:06:06.246344 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-83e28856-dbfc-471a-908d-2fab9903a451 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:06:06.247561 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-83e28856-dbfc-471a-908d-2fab9903a451 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:06:06.248826 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-83e28856-dbfc-471a-908d-2fab9903a451 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:06:06.399315 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-83e28856-dbfc-471a-908d-2fab9903a451 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] 10.222.0.47 "POST /compute/v2.1/servers/f5e90100-1612-4e18-b86c-db90e3045760/action" status: 200 len: 18299 microversion: 2.1 time: 0.183688 Feb 19 05:06:06.408444 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 414/821] 10.222.0.47 () {60 vars in 1268 bytes} [Fri Feb 19 05:06:06 2021] POST /compute/v2.1/servers/f5e90100-1612-4e18-b86c-db90e3045760/action => generated 18299 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 19 05:06:07.162825 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-2c104cc6-0bf0-4046-80a9-8c8f906cd85c tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Action: 'create', calling method: .version_select at 0x7f27064ec0d0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1012313419"}} {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:06:07.189336 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.quota [None req-2c104cc6-0bf0-4046-80a9-8c8f906cd85c tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Getting quotas for project f87857a2fc3a4866a8055ed181d12edf. Resources: {'key_pairs'} {{(pid=98153) _get_quotas /opt/stack/nova/nova/quota.py:388}} Feb 19 05:06:07.194272 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.quota [None req-2c104cc6-0bf0-4046-80a9-8c8f906cd85c tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Getting quotas for user 32f894b7dad5447688fb395e08d31d4c and project f87857a2fc3a4866a8055ed181d12edf. Resources: {'key_pairs'} {{(pid=98153) _get_quotas /opt/stack/nova/nova/quota.py:380}} Feb 19 05:06:07.365180 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.quota [None req-2c104cc6-0bf0-4046-80a9-8c8f906cd85c tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Getting quotas for project f87857a2fc3a4866a8055ed181d12edf. Resources: {'key_pairs'} {{(pid=98153) _get_quotas /opt/stack/nova/nova/quota.py:388}} Feb 19 05:06:07.369583 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.quota [None req-2c104cc6-0bf0-4046-80a9-8c8f906cd85c tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Getting quotas for user 32f894b7dad5447688fb395e08d31d4c and project f87857a2fc3a4866a8055ed181d12edf. Resources: {'key_pairs'} {{(pid=98153) _get_quotas /opt/stack/nova/nova/quota.py:380}} Feb 19 05:06:07.379272 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-fb5f7841-ce92-4e00-8e5c-6b28657333d2 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:06:07.380136 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-fb5f7841-ce92-4e00-8e5c-6b28657333d2 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] [instance: dcb11872-0660-4e35-8d91-bfe80088844b] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:06:07.384283 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-2c104cc6-0bf0-4046-80a9-8c8f906cd85c tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 2315 microversion: 2.1 time: 0.467236 Feb 19 05:06:07.390904 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-fb5f7841-ce92-4e00-8e5c-6b28657333d2 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:06:07.391203 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 408/822] 10.222.0.47 () {60 vars in 1148 bytes} [Fri Feb 19 05:06:06 2021] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:06:07.391785 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-fb5f7841-ce92-4e00-8e5c-6b28657333d2 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:06:07.392649 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-fb5f7841-ce92-4e00-8e5c-6b28657333d2 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:06:07.393139 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-fb5f7841-ce92-4e00-8e5c-6b28657333d2 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:06:07.396612 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-2f34f481-6d4d-47be-b484-e8241cb2ce51 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Action: 'create', calling method: .version_select at 0x7f270bb2b598>, body: {"security_group": {"name": "tempest-TestVolumeBootPattern-1266909124", "description": "tempest-TestVolumeBootPattern-1266909124 description"}} {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:06:07.458435 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.objects.instance [None req-fb5f7841-ce92-4e00-8e5c-6b28657333d2 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lazy-loading 'flavor' on Instance uuid dcb11872-0660-4e35-8d91-bfe80088844b {{(pid=98154) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Feb 19 05:06:07.677584 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-2f34f481-6d4d-47be-b484-e8241cb2ce51 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] 10.222.0.47 "POST /compute/v2.1/os-security-groups" status: 200 len: 251 microversion: 2.1 time: 0.284404 Feb 19 05:06:07.680064 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 409/823] 10.222.0.47 () {60 vars in 1170 bytes} [Fri Feb 19 05:06:07 2021] POST /compute/v2.1/os-security-groups => generated 251 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 05:06:07.692392 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-ad40acb4-c14f-4c03-8f58-6cf26a65526a tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:06:07.693691 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-ad40acb4-c14f-4c03-8f58-6cf26a65526a tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] [instance: f5e90100-1612-4e18-b86c-db90e3045760] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:06:07.705229 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-ad40acb4-c14f-4c03-8f58-6cf26a65526a tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:06:07.705746 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-ad40acb4-c14f-4c03-8f58-6cf26a65526a tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:06:07.706706 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-ad40acb4-c14f-4c03-8f58-6cf26a65526a tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:06:07.707202 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-ad40acb4-c14f-4c03-8f58-6cf26a65526a tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:06:07.853627 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-ad40acb4-c14f-4c03-8f58-6cf26a65526a tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] 10.222.0.47 "POST /compute/v2.1/servers/f5e90100-1612-4e18-b86c-db90e3045760/action" status: 200 len: 20173 microversion: 2.1 time: 0.170070 Feb 19 05:06:07.859213 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 410/824] 10.222.0.47 () {60 vars in 1268 bytes} [Fri Feb 19 05:06:07 2021] POST /compute/v2.1/servers/f5e90100-1612-4e18-b86c-db90e3045760/action => generated 20173 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 19 05:06:07.870212 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-408c25ff-c8d1-457c-8402-3b81e6c408c5 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Action: 'create', calling method: .version_select at 0x7f27067cfae8>, body: {"security_group_rule": {"parent_group_id": "c724db31-0d22-4619-9a65-6958d0e05594", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "cidr": "0.0.0.0/0"}} {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:06:07.883652 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-fb5f7841-ce92-4e00-8e5c-6b28657333d2 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] 10.222.0.47 "POST /compute/v2.1/servers/dcb11872-0660-4e35-8d91-bfe80088844b/action" status: 202 len: 0 microversion: 2.20 time: 0.509025 Feb 19 05:06:07.884674 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 415/825] 10.222.0.47 () {62 vars in 1309 bytes} [Fri Feb 19 05:06:07 2021] POST /compute/v2.1/servers/dcb11872-0660-4e35-8d91-bfe80088844b/action => generated 0 bytes in 512 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Feb 19 05:06:07.904438 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-a215f893-874b-4e44-ad2b-fe4b44299056 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:06:07.905698 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-a215f893-874b-4e44-ad2b-fe4b44299056 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] [instance: dcb11872-0660-4e35-8d91-bfe80088844b] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:06:07.927015 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-a215f893-874b-4e44-ad2b-fe4b44299056 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:06:07.927564 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-a215f893-874b-4e44-ad2b-fe4b44299056 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:06:07.929852 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-a215f893-874b-4e44-ad2b-fe4b44299056 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:06:07.930172 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-a215f893-874b-4e44-ad2b-fe4b44299056 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:06:08.293359 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-a215f893-874b-4e44-ad2b-fe4b44299056 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:06:08.304740 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-a215f893-874b-4e44-ad2b-fe4b44299056 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:06:08.306257 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-a215f893-874b-4e44-ad2b-fe4b44299056 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:06:08.307841 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-a215f893-874b-4e44-ad2b-fe4b44299056 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] 10.222.0.47 "GET /compute/v2.1/servers/dcb11872-0660-4e35-8d91-bfe80088844b" status: 200 len: 1723 microversion: 2.20 time: 0.408255 Feb 19 05:06:08.308455 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 416/826] 10.222.0.47 () {60 vars in 1267 bytes} [Fri Feb 19 05:06:07 2021] GET /compute/v2.1/servers/dcb11872-0660-4e35-8d91-bfe80088844b => generated 1723 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 05:06:08.359210 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-408c25ff-c8d1-457c-8402-3b81e6c408c5 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] 10.222.0.47 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.499813 Feb 19 05:06:08.359961 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 411/827] 10.222.0.47 () {60 vars in 1185 bytes} [Fri Feb 19 05:06:07 2021] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 05:06:08.371528 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-98bcee41-6902-43d3-985c-5902a1ad8922 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Action: 'create', calling method: .version_select at 0x7f27064fd950>, body: {"security_group_rule": {"parent_group_id": "c724db31-0d22-4619-9a65-6958d0e05594", "ip_protocol": "icmp", "from_port": -1, "to_port": -1, "cidr": "0.0.0.0/0"}} {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:06:08.626187 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-98bcee41-6902-43d3-985c-5902a1ad8922 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] 10.222.0.47 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 233 microversion: 2.1 time: 0.258933 Feb 19 05:06:08.626860 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 417/828] 10.222.0.47 () {60 vars in 1185 bytes} [Fri Feb 19 05:06:08 2021] POST /compute/v2.1/os-security-group-rules => generated 233 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 05:06:08.874248 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-e904a0f9-4a99-4c06-9678-318326cb71fc tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:06:08.875823 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-e904a0f9-4a99-4c06-9678-318326cb71fc tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] [instance: f5e90100-1612-4e18-b86c-db90e3045760] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:06:08.885778 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-e904a0f9-4a99-4c06-9678-318326cb71fc tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:06:08.886658 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-e904a0f9-4a99-4c06-9678-318326cb71fc tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:06:08.887639 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-e904a0f9-4a99-4c06-9678-318326cb71fc tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:06:08.888203 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-e904a0f9-4a99-4c06-9678-318326cb71fc tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:06:09.087978 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-e904a0f9-4a99-4c06-9678-318326cb71fc tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] 10.222.0.47 "POST /compute/v2.1/servers/f5e90100-1612-4e18-b86c-db90e3045760/action" status: 200 len: 22759 microversion: 2.1 time: 0.218194 Feb 19 05:06:09.093402 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 412/829] 10.222.0.47 () {60 vars in 1268 bytes} [Fri Feb 19 05:06:08 2021] POST /compute/v2.1/servers/f5e90100-1612-4e18-b86c-db90e3045760/action => generated 22759 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 19 05:06:09.330313 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-25436df6-9252-412e-943e-fcdfee524b19 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:06:09.330998 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-25436df6-9252-412e-943e-fcdfee524b19 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] [instance: dcb11872-0660-4e35-8d91-bfe80088844b] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:06:09.339651 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-25436df6-9252-412e-943e-fcdfee524b19 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:06:09.340016 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-25436df6-9252-412e-943e-fcdfee524b19 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:06:09.340889 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-25436df6-9252-412e-943e-fcdfee524b19 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:06:09.341386 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-25436df6-9252-412e-943e-fcdfee524b19 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:06:09.628102 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-25436df6-9252-412e-943e-fcdfee524b19 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:06:09.648298 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-25436df6-9252-412e-943e-fcdfee524b19 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:06:09.651494 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-25436df6-9252-412e-943e-fcdfee524b19 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:06:09.653882 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-25436df6-9252-412e-943e-fcdfee524b19 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] 10.222.0.47 "GET /compute/v2.1/servers/dcb11872-0660-4e35-8d91-bfe80088844b" status: 200 len: 1723 microversion: 2.20 time: 0.328232 Feb 19 05:06:09.655057 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 418/830] 10.222.0.47 () {60 vars in 1267 bytes} [Fri Feb 19 05:06:09 2021] GET /compute/v2.1/servers/dcb11872-0660-4e35-8d91-bfe80088844b => generated 1723 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 05:06:10.101992 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-609597c4-2477-4a84-bdc4-1626b066b508 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:06:10.103138 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-609597c4-2477-4a84-bdc4-1626b066b508 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] [instance: f5e90100-1612-4e18-b86c-db90e3045760] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:06:10.113382 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-609597c4-2477-4a84-bdc4-1626b066b508 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:06:10.113888 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-609597c4-2477-4a84-bdc4-1626b066b508 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:06:10.114752 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-609597c4-2477-4a84-bdc4-1626b066b508 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:06:10.115245 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-609597c4-2477-4a84-bdc4-1626b066b508 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:06:10.266151 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-609597c4-2477-4a84-bdc4-1626b066b508 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] 10.222.0.47 "POST /compute/v2.1/servers/f5e90100-1612-4e18-b86c-db90e3045760/action" status: 200 len: 23798 microversion: 2.1 time: 0.168303 Feb 19 05:06:10.266800 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 413/831] 10.222.0.47 () {60 vars in 1268 bytes} [Fri Feb 19 05:06:10 2021] POST /compute/v2.1/servers/f5e90100-1612-4e18-b86c-db90e3045760/action => generated 23798 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 19 05:06:10.676262 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-3aeed3d2-e9b7-4db4-99a2-069d1adbbd7f tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:06:10.676935 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-3aeed3d2-e9b7-4db4-99a2-069d1adbbd7f tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] [instance: dcb11872-0660-4e35-8d91-bfe80088844b] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:06:10.686798 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-3aeed3d2-e9b7-4db4-99a2-069d1adbbd7f tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:06:10.687308 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-3aeed3d2-e9b7-4db4-99a2-069d1adbbd7f tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:06:10.688187 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-3aeed3d2-e9b7-4db4-99a2-069d1adbbd7f tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:06:10.688670 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-3aeed3d2-e9b7-4db4-99a2-069d1adbbd7f tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:06:10.964288 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-3aeed3d2-e9b7-4db4-99a2-069d1adbbd7f tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:06:10.975310 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-3aeed3d2-e9b7-4db4-99a2-069d1adbbd7f tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:06:10.976922 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-3aeed3d2-e9b7-4db4-99a2-069d1adbbd7f tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:06:10.978378 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-3aeed3d2-e9b7-4db4-99a2-069d1adbbd7f tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] 10.222.0.47 "GET /compute/v2.1/servers/dcb11872-0660-4e35-8d91-bfe80088844b" status: 200 len: 1723 microversion: 2.20 time: 0.307235 Feb 19 05:06:10.979158 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 419/832] 10.222.0.47 () {60 vars in 1267 bytes} [Fri Feb 19 05:06:10 2021] GET /compute/v2.1/servers/dcb11872-0660-4e35-8d91-bfe80088844b => generated 1723 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 05:06:11.281398 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-7a3c9d0c-4944-4f21-8803-da013427e3c1 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:06:11.282550 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-7a3c9d0c-4944-4f21-8803-da013427e3c1 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] [instance: f5e90100-1612-4e18-b86c-db90e3045760] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:06:11.291933 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-7a3c9d0c-4944-4f21-8803-da013427e3c1 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:06:11.292433 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-7a3c9d0c-4944-4f21-8803-da013427e3c1 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:06:11.293295 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-7a3c9d0c-4944-4f21-8803-da013427e3c1 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:06:11.293784 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-7a3c9d0c-4944-4f21-8803-da013427e3c1 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:06:11.439624 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-7a3c9d0c-4944-4f21-8803-da013427e3c1 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] 10.222.0.47 "POST /compute/v2.1/servers/f5e90100-1612-4e18-b86c-db90e3045760/action" status: 200 len: 25054 microversion: 2.1 time: 0.163070 Feb 19 05:06:11.443397 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 414/833] 10.222.0.47 () {60 vars in 1268 bytes} [Fri Feb 19 05:06:11 2021] POST /compute/v2.1/servers/f5e90100-1612-4e18-b86c-db90e3045760/action => generated 25054 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 19 05:06:11.640227 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-7bb31b69-4bd3-459f-a79e-b6e950e15d62 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-TestMinimumBasicScenario-2031567781"}} {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:06:11.640778 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-7bb31b69-4bd3-459f-a79e-b6e950e15d62 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] [instance: 0ae0d266-c297-45f1-80fe-0e8f84cc22e6] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:06:11.650831 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-7bb31b69-4bd3-459f-a79e-b6e950e15d62 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:06:11.651355 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-7bb31b69-4bd3-459f-a79e-b6e950e15d62 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:06:11.652213 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-7bb31b69-4bd3-459f-a79e-b6e950e15d62 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:06:11.652697 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-7bb31b69-4bd3-459f-a79e-b6e950e15d62 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:06:12.006122 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-c2fba8b7-ae0c-41c2-bdd4-2c742793d5ef tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:06:12.007315 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-c2fba8b7-ae0c-41c2-bdd4-2c742793d5ef tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] [instance: dcb11872-0660-4e35-8d91-bfe80088844b] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:06:12.027829 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-c2fba8b7-ae0c-41c2-bdd4-2c742793d5ef tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:06:12.029234 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-c2fba8b7-ae0c-41c2-bdd4-2c742793d5ef tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:06:12.030896 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-c2fba8b7-ae0c-41c2-bdd4-2c742793d5ef tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:06:12.031732 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-c2fba8b7-ae0c-41c2-bdd4-2c742793d5ef tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:06:12.253423 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.network.security_group_api [None req-7bb31b69-4bd3-459f-a79e-b6e950e15d62 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Removing security group e28a7a56-f099-4d02-befc-b2472b7b4da5 from port fa4d6bd7-26d3-4df0-ac31-ae6f1438d6f5 Feb 19 05:06:12.561894 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-c2fba8b7-ae0c-41c2-bdd4-2c742793d5ef tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:06:12.579635 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-c2fba8b7-ae0c-41c2-bdd4-2c742793d5ef tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:06:12.581817 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-c2fba8b7-ae0c-41c2-bdd4-2c742793d5ef tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:06:12.583502 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-c2fba8b7-ae0c-41c2-bdd4-2c742793d5ef tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] 10.222.0.47 "GET /compute/v2.1/servers/dcb11872-0660-4e35-8d91-bfe80088844b" status: 200 len: 1723 microversion: 2.20 time: 0.587310 Feb 19 05:06:12.584482 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 415/834] 10.222.0.47 () {60 vars in 1267 bytes} [Fri Feb 19 05:06:11 2021] GET /compute/v2.1/servers/dcb11872-0660-4e35-8d91-bfe80088844b => generated 1723 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 05:06:12.595366 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-00464f6a-d1f1-48e4-af3c-a20ae975dda5 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:06:12.597946 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-00464f6a-d1f1-48e4-af3c-a20ae975dda5 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] [instance: f5e90100-1612-4e18-b86c-db90e3045760] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:06:12.619609 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-00464f6a-d1f1-48e4-af3c-a20ae975dda5 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:06:12.621547 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-00464f6a-d1f1-48e4-af3c-a20ae975dda5 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:06:12.624135 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-00464f6a-d1f1-48e4-af3c-a20ae975dda5 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:06:12.625460 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-00464f6a-d1f1-48e4-af3c-a20ae975dda5 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:06:12.843382 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-00464f6a-d1f1-48e4-af3c-a20ae975dda5 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] 10.222.0.47 "POST /compute/v2.1/servers/f5e90100-1612-4e18-b86c-db90e3045760/action" status: 200 len: 26738 microversion: 2.1 time: 0.255990 Feb 19 05:06:12.845222 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 416/835] 10.222.0.47 () {60 vars in 1268 bytes} [Fri Feb 19 05:06:12 2021] POST /compute/v2.1/servers/f5e90100-1612-4e18-b86c-db90e3045760/action => generated 26738 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 19 05:06:13.442288 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-7bb31b69-4bd3-459f-a79e-b6e950e15d62 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] 10.222.0.47 "POST /compute/v2.1/servers/0ae0d266-c297-45f1-80fe-0e8f84cc22e6/action" status: 202 len: 0 microversion: 2.1 time: 1.806570 Feb 19 05:06:13.447813 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 420/836] 10.222.0.47 () {60 vars in 1268 bytes} [Fri Feb 19 05:06:11 2021] POST /compute/v2.1/servers/0ae0d266-c297-45f1-80fe-0e8f84cc22e6/action => generated 0 bytes in 1814 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 19 05:06:13.453841 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [req-408943ae-bca7-4692-9ff3-c07ddc1cc3f7 req-95f20688-e244-44e7-bb74-d316a627bfe5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ae0d266-c297-45f1-80fe-0e8f84cc22e6", "tag": "fa4d6bd7-26d3-4df0-ac31-ae6f1438d6f5"}]} {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:06:13.456904 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 05:06:13.456904 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: warnings.warn(msg) Feb 19 05:06:13.457524 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-d898e265-3a0e-4adb-a8e1-89ad0494a6ca tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Calling method '.version_select at 0x7f270736f730>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:06:13.486804 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [req-408943ae-bca7-4692-9ff3-c07ddc1cc3f7 req-95f20688-e244-44e7-bb74-d316a627bfe5 service nova] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:06:13.487315 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [req-408943ae-bca7-4692-9ff3-c07ddc1cc3f7 req-95f20688-e244-44e7-bb74-d316a627bfe5 service nova] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:06:13.514174 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.compute.server_external_events [req-408943ae-bca7-4692-9ff3-c07ddc1cc3f7 req-95f20688-e244-44e7-bb74-d316a627bfe5 service nova] Creating event network-changed:fa4d6bd7-26d3-4df0-ac31-ae6f1438d6f5 for instance 0ae0d266-c297-45f1-80fe-0e8f84cc22e6 on hv-cinder-77642 Feb 19 05:06:13.521360 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [req-408943ae-bca7-4692-9ff3-c07ddc1cc3f7 req-95f20688-e244-44e7-bb74-d316a627bfe5 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074100 Feb 19 05:06:13.523456 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 417/837] 10.222.0.47 () {64 vars in 1308 bytes} [Fri Feb 19 05:06:13 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 19 05:06:13.638269 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-234f69c4-5cc0-4f77-b922-ff47a224fd0a tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:06:13.640368 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-234f69c4-5cc0-4f77-b922-ff47a224fd0a tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] [instance: dcb11872-0660-4e35-8d91-bfe80088844b] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:06:13.649489 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-234f69c4-5cc0-4f77-b922-ff47a224fd0a tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:06:13.650524 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-234f69c4-5cc0-4f77-b922-ff47a224fd0a tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:06:13.651686 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-234f69c4-5cc0-4f77-b922-ff47a224fd0a tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:06:13.652566 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-234f69c4-5cc0-4f77-b922-ff47a224fd0a tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:06:14.222417 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-234f69c4-5cc0-4f77-b922-ff47a224fd0a tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:06:14.235948 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-d898e265-3a0e-4adb-a8e1-89ad0494a6ca tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] 10.222.0.47 "DELETE /compute/v2.1/os-security-groups/e28a7a56-f099-4d02-befc-b2472b7b4da5" status: 202 len: 0 microversion: 2.1 time: 0.781770 Feb 19 05:06:14.236849 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 421/838] 10.222.0.47 () {58 vars in 1262 bytes} [Fri Feb 19 05:06:13 2021] DELETE /compute/v2.1/os-security-groups/e28a7a56-f099-4d02-befc-b2472b7b4da5 => generated 0 bytes in 784 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Feb 19 05:06:14.243321 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-fdaee794-e197-4806-acf9-cd95734b7264 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:06:14.244492 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-234f69c4-5cc0-4f77-b922-ff47a224fd0a tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:06:14.246091 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-234f69c4-5cc0-4f77-b922-ff47a224fd0a tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:06:14.246995 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-fdaee794-e197-4806-acf9-cd95734b7264 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] [instance: f5e90100-1612-4e18-b86c-db90e3045760] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:06:14.247369 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-234f69c4-5cc0-4f77-b922-ff47a224fd0a tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] 10.222.0.47 "GET /compute/v2.1/servers/dcb11872-0660-4e35-8d91-bfe80088844b" status: 200 len: 1723 microversion: 2.20 time: 0.627009 Feb 19 05:06:14.248083 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 418/839] 10.222.0.47 () {60 vars in 1267 bytes} [Fri Feb 19 05:06:13 2021] GET /compute/v2.1/servers/dcb11872-0660-4e35-8d91-bfe80088844b => generated 1723 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 19 05:06:14.265990 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-d4419a63-0d5c-47d6-8de2-3721d80cb498 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Calling method '.version_select at 0x7f2707ad68c8>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:06:14.274187 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-fdaee794-e197-4806-acf9-cd95734b7264 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:06:14.277443 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-fdaee794-e197-4806-acf9-cd95734b7264 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:06:14.279867 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-fdaee794-e197-4806-acf9-cd95734b7264 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:06:14.282769 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-fdaee794-e197-4806-acf9-cd95734b7264 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:06:14.505928 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-fdaee794-e197-4806-acf9-cd95734b7264 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] 10.222.0.47 "POST /compute/v2.1/servers/f5e90100-1612-4e18-b86c-db90e3045760/action" status: 200 len: 27720 microversion: 2.1 time: 0.267103 Feb 19 05:06:14.507214 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 422/840] 10.222.0.47 () {60 vars in 1268 bytes} [Fri Feb 19 05:06:14 2021] POST /compute/v2.1/servers/f5e90100-1612-4e18-b86c-db90e3045760/action => generated 27720 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 19 05:06:15.221533 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-d4419a63-0d5c-47d6-8de2-3721d80cb498 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] [instance: 0ae0d266-c297-45f1-80fe-0e8f84cc22e6] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:06:15.241137 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-d4419a63-0d5c-47d6-8de2-3721d80cb498 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:06:15.242078 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-d4419a63-0d5c-47d6-8de2-3721d80cb498 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:06:15.248392 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-d4419a63-0d5c-47d6-8de2-3721d80cb498 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:06:15.250197 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-d4419a63-0d5c-47d6-8de2-3721d80cb498 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:06:15.279232 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-f94fe93f-e6b9-4a51-8633-9ba1f1d8a575 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:06:15.281896 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-f94fe93f-e6b9-4a51-8633-9ba1f1d8a575 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] [instance: dcb11872-0660-4e35-8d91-bfe80088844b] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:06:15.301852 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-f94fe93f-e6b9-4a51-8633-9ba1f1d8a575 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:06:15.302863 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-f94fe93f-e6b9-4a51-8633-9ba1f1d8a575 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:06:15.304128 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-f94fe93f-e6b9-4a51-8633-9ba1f1d8a575 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:06:15.305912 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-f94fe93f-e6b9-4a51-8633-9ba1f1d8a575 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:06:15.372730 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-d4419a63-0d5c-47d6-8de2-3721d80cb498 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Acquired lock "refresh_cache-0ae0d266-c297-45f1-80fe-0e8f84cc22e6" {{(pid=98153) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:266}} Feb 19 05:06:15.419061 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 19 05:06:15.419293 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: Fri Feb 19 05:06:15 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/dcb11872-0660-4e35-8d91-bfe80088844b (ip 10.222.0.47) !!! Feb 19 05:06:16.156586 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-f94fe93f-e6b9-4a51-8633-9ba1f1d8a575 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:06:16.172552 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-f94fe93f-e6b9-4a51-8633-9ba1f1d8a575 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:06:16.176004 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-f94fe93f-e6b9-4a51-8633-9ba1f1d8a575 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:06:16.178178 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-f94fe93f-e6b9-4a51-8633-9ba1f1d8a575 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] 10.222.0.47 "GET /compute/v2.1/servers/dcb11872-0660-4e35-8d91-bfe80088844b" status: 200 len: 1723 microversion: 2.20 time: 0.908139 Feb 19 05:06:16.179229 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 423/841] 10.222.0.47 () {60 vars in 1267 bytes} [Fri Feb 19 05:06:15 2021] GET /compute/v2.1/servers/dcb11872-0660-4e35-8d91-bfe80088844b => generated 1723 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 05:06:16.187916 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-8a02e049-5fab-48ec-abc3-0d616e62e069 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:06:16.188979 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-8a02e049-5fab-48ec-abc3-0d616e62e069 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] [instance: f5e90100-1612-4e18-b86c-db90e3045760] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:06:16.205667 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-8a02e049-5fab-48ec-abc3-0d616e62e069 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:06:16.206294 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-8a02e049-5fab-48ec-abc3-0d616e62e069 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:06:16.207366 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-8a02e049-5fab-48ec-abc3-0d616e62e069 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:06:16.207975 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-8a02e049-5fab-48ec-abc3-0d616e62e069 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:06:16.370825 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-8a02e049-5fab-48ec-abc3-0d616e62e069 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] 10.222.0.47 "POST /compute/v2.1/servers/f5e90100-1612-4e18-b86c-db90e3045760/action" status: 200 len: 28199 microversion: 2.1 time: 0.189721 Feb 19 05:06:16.371791 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 424/842] 10.222.0.47 () {60 vars in 1268 bytes} [Fri Feb 19 05:06:16 2021] POST /compute/v2.1/servers/f5e90100-1612-4e18-b86c-db90e3045760/action => generated 28199 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 19 05:06:17.200084 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-5397f0bf-b3a5-4d3d-a429-b811a927f47a tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:06:17.201520 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-5397f0bf-b3a5-4d3d-a429-b811a927f47a tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] [instance: dcb11872-0660-4e35-8d91-bfe80088844b] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:06:17.210890 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-5397f0bf-b3a5-4d3d-a429-b811a927f47a tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:06:17.211802 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-5397f0bf-b3a5-4d3d-a429-b811a927f47a tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:06:17.212985 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-5397f0bf-b3a5-4d3d-a429-b811a927f47a tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:06:17.213692 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-5397f0bf-b3a5-4d3d-a429-b811a927f47a tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:06:17.756235 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-5397f0bf-b3a5-4d3d-a429-b811a927f47a tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:06:17.768208 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-5397f0bf-b3a5-4d3d-a429-b811a927f47a tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:06:17.780186 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-5397f0bf-b3a5-4d3d-a429-b811a927f47a tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:06:17.780186 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-5397f0bf-b3a5-4d3d-a429-b811a927f47a tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] 10.222.0.47 "GET /compute/v2.1/servers/dcb11872-0660-4e35-8d91-bfe80088844b" status: 200 len: 1723 microversion: 2.20 time: 0.577198 Feb 19 05:06:17.780186 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 425/843] 10.222.0.47 () {60 vars in 1267 bytes} [Fri Feb 19 05:06:17 2021] GET /compute/v2.1/servers/dcb11872-0660-4e35-8d91-bfe80088844b => generated 1723 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 05:06:17.784693 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-0cfab44d-e83c-482c-872f-0c4a17fd7af8 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:06:17.786889 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-0cfab44d-e83c-482c-872f-0c4a17fd7af8 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] [instance: f5e90100-1612-4e18-b86c-db90e3045760] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:06:17.798050 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-0cfab44d-e83c-482c-872f-0c4a17fd7af8 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:06:17.798903 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-0cfab44d-e83c-482c-872f-0c4a17fd7af8 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:06:17.799813 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-0cfab44d-e83c-482c-872f-0c4a17fd7af8 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:06:17.800381 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-0cfab44d-e83c-482c-872f-0c4a17fd7af8 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:06:17.952105 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-0cfab44d-e83c-482c-872f-0c4a17fd7af8 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] 10.222.0.47 "POST /compute/v2.1/servers/f5e90100-1612-4e18-b86c-db90e3045760/action" status: 200 len: 28199 microversion: 2.1 time: 0.168343 Feb 19 05:06:17.954043 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 426/844] 10.222.0.47 () {60 vars in 1268 bytes} [Fri Feb 19 05:06:17 2021] POST /compute/v2.1/servers/f5e90100-1612-4e18-b86c-db90e3045760/action => generated 28199 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 19 05:06:17.974930 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.network.neutron [None req-d4419a63-0d5c-47d6-8de2-3721d80cb498 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] [instance: 0ae0d266-c297-45f1-80fe-0e8f84cc22e6] Building network info cache for instance {{(pid=98153) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1836}} Feb 19 05:06:18.008007 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [req-d18f8b02-84bb-430d-a29b-e7bbaae2c2bc req-f9a8886e-e2e9-4202-aeb4-3aca7da82870 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ae0d266-c297-45f1-80fe-0e8f84cc22e6", "tag": "fa4d6bd7-26d3-4df0-ac31-ae6f1438d6f5"}]} {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:06:18.016698 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 05:06:18.016698 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: warnings.warn(msg) Feb 19 05:06:18.028189 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [req-d18f8b02-84bb-430d-a29b-e7bbaae2c2bc req-f9a8886e-e2e9-4202-aeb4-3aca7da82870 service nova] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:06:18.029566 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [req-d18f8b02-84bb-430d-a29b-e7bbaae2c2bc req-f9a8886e-e2e9-4202-aeb4-3aca7da82870 service nova] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:06:18.050598 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.compute.server_external_events [req-d18f8b02-84bb-430d-a29b-e7bbaae2c2bc req-f9a8886e-e2e9-4202-aeb4-3aca7da82870 service nova] Creating event network-changed:fa4d6bd7-26d3-4df0-ac31-ae6f1438d6f5 for instance 0ae0d266-c297-45f1-80fe-0e8f84cc22e6 on hv-cinder-77642 Feb 19 05:06:18.056427 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [req-d18f8b02-84bb-430d-a29b-e7bbaae2c2bc req-f9a8886e-e2e9-4202-aeb4-3aca7da82870 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067532 Feb 19 05:06:18.058785 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 427/845] 10.222.0.47 () {64 vars in 1308 bytes} [Fri Feb 19 05:06:17 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 05:06:18.796278 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-386e917b-86a4-4f95-a5b7-ee7f2c48f13b tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:06:18.797751 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-386e917b-86a4-4f95-a5b7-ee7f2c48f13b tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] [instance: dcb11872-0660-4e35-8d91-bfe80088844b] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:06:18.808660 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-386e917b-86a4-4f95-a5b7-ee7f2c48f13b tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:06:18.813140 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-386e917b-86a4-4f95-a5b7-ee7f2c48f13b tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:06:18.814356 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-386e917b-86a4-4f95-a5b7-ee7f2c48f13b tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:06:18.815086 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-386e917b-86a4-4f95-a5b7-ee7f2c48f13b tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:06:19.434528 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-386e917b-86a4-4f95-a5b7-ee7f2c48f13b tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:06:19.448802 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-386e917b-86a4-4f95-a5b7-ee7f2c48f13b tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:06:19.450358 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-386e917b-86a4-4f95-a5b7-ee7f2c48f13b tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:06:19.452142 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-386e917b-86a4-4f95-a5b7-ee7f2c48f13b tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] 10.222.0.47 "GET /compute/v2.1/servers/dcb11872-0660-4e35-8d91-bfe80088844b" status: 200 len: 1744 microversion: 2.20 time: 0.661432 Feb 19 05:06:19.463631 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 428/846] 10.222.0.47 () {60 vars in 1267 bytes} [Fri Feb 19 05:06:18 2021] GET /compute/v2.1/servers/dcb11872-0660-4e35-8d91-bfe80088844b => generated 1744 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 05:06:19.463631 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-2bf5aa04-21f3-4389-9111-33a634051837 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:06:19.463631 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-2bf5aa04-21f3-4389-9111-33a634051837 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] [instance: f5e90100-1612-4e18-b86c-db90e3045760] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:06:19.467560 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-2bf5aa04-21f3-4389-9111-33a634051837 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:06:19.467780 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-2bf5aa04-21f3-4389-9111-33a634051837 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:06:19.468849 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-2bf5aa04-21f3-4389-9111-33a634051837 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:06:19.469285 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-2bf5aa04-21f3-4389-9111-33a634051837 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:06:19.617957 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-2bf5aa04-21f3-4389-9111-33a634051837 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] 10.222.0.47 "POST /compute/v2.1/servers/f5e90100-1612-4e18-b86c-db90e3045760/action" status: 200 len: 28489 microversion: 2.1 time: 0.163191 Feb 19 05:06:19.622786 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 429/847] 10.222.0.47 () {60 vars in 1268 bytes} [Fri Feb 19 05:06:19 2021] POST /compute/v2.1/servers/f5e90100-1612-4e18-b86c-db90e3045760/action => generated 28489 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 19 05:06:19.855437 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.network.neutron [None req-d4419a63-0d5c-47d6-8de2-3721d80cb498 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] [instance: 0ae0d266-c297-45f1-80fe-0e8f84cc22e6] Updating instance_info_cache with network_info: [{"id": "fa4d6bd7-26d3-4df0-ac31-ae6f1438d6f5", "address": "fa:16:3e:8e:ea:b2", "network": {"id": "5cb4ec90-ce43-4ddc-ac74-490620baaffe", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1740998779-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "3309eb07e18a46a2a0bcbde1f9e46dd8", "mtu": 1450, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, "devname": "tapfa4d6bd7-26", "ovs_interfaceid": "fa4d6bd7-26d3-4df0-ac31-ae6f1438d6f5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "meta": {}}] {{(pid=98153) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Feb 19 05:06:19.868990 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-d4419a63-0d5c-47d6-8de2-3721d80cb498 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Releasing lock "refresh_cache-0ae0d266-c297-45f1-80fe-0e8f84cc22e6" {{(pid=98153) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:282}} Feb 19 05:06:19.869999 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-d4419a63-0d5c-47d6-8de2-3721d80cb498 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] 10.222.0.47 "DELETE /compute/v2.1/os-floating-ips/63e7c209-e49e-42e0-b57d-cdc17e8c2b63" status: 202 len: 0 microversion: 2.1 time: 5.620817 Feb 19 05:06:19.872201 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 419/848] 10.222.0.47 () {58 vars in 1253 bytes} [Fri Feb 19 05:06:14 2021] DELETE /compute/v2.1/os-floating-ips/63e7c209-e49e-42e0-b57d-cdc17e8c2b63 => generated 0 bytes in 5622 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 19 05:06:19.884383 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-08f782bf-280c-4379-8233-2c55f92d4019 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:06:19.885040 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-08f782bf-280c-4379-8233-2c55f92d4019 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] [instance: 0ae0d266-c297-45f1-80fe-0e8f84cc22e6] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:06:19.894598 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-08f782bf-280c-4379-8233-2c55f92d4019 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:06:19.895114 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-08f782bf-280c-4379-8233-2c55f92d4019 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:06:19.896053 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-08f782bf-280c-4379-8233-2c55f92d4019 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:06:19.896558 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-08f782bf-280c-4379-8233-2c55f92d4019 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:06:20.111714 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.objects.instance [None req-08f782bf-280c-4379-8233-2c55f92d4019 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Lazy-loading 'services' on Instance uuid 0ae0d266-c297-45f1-80fe-0e8f84cc22e6 {{(pid=98154) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Feb 19 05:06:20.265435 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-08f782bf-280c-4379-8233-2c55f92d4019 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] 10.222.0.47 "DELETE /compute/v2.1/servers/0ae0d266-c297-45f1-80fe-0e8f84cc22e6/os-volume_attachments/20c7685c-bba3-4282-b9ae-ee918056d0c5" status: 202 len: 0 microversion: 2.1 time: 0.388151 Feb 19 05:06:20.266159 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 430/849] 10.222.0.47 () {58 vars in 1406 bytes} [Fri Feb 19 05:06:19 2021] DELETE /compute/v2.1/servers/0ae0d266-c297-45f1-80fe-0e8f84cc22e6/os-volume_attachments/20c7685c-bba3-4282-b9ae-ee918056d0c5 => generated 0 bytes in 391 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 19 05:06:20.275353 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-67acdf8b-405e-4636-ba9c-66c4911d47ed tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:06:20.276551 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-67acdf8b-405e-4636-ba9c-66c4911d47ed tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] [instance: 0ae0d266-c297-45f1-80fe-0e8f84cc22e6] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:06:20.286293 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-67acdf8b-405e-4636-ba9c-66c4911d47ed tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:06:20.286803 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-67acdf8b-405e-4636-ba9c-66c4911d47ed tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:06:20.287727 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-67acdf8b-405e-4636-ba9c-66c4911d47ed tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:06:20.288257 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-67acdf8b-405e-4636-ba9c-66c4911d47ed tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:06:20.364254 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-67acdf8b-405e-4636-ba9c-66c4911d47ed tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] 10.222.0.47 "GET /compute/v2.1/servers/0ae0d266-c297-45f1-80fe-0e8f84cc22e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.093185 Feb 19 05:06:20.364902 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 420/850] 10.222.0.47 () {58 vars in 1292 bytes} [Fri Feb 19 05:06:20 2021] GET /compute/v2.1/servers/0ae0d266-c297-45f1-80fe-0e8f84cc22e6/os-volume_attachments => generated 197 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 05:06:20.477595 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-3c6a2bb0-e969-4216-85ff-6bbc54d4b9e5 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:06:20.478373 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-3c6a2bb0-e969-4216-85ff-6bbc54d4b9e5 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] [instance: dcb11872-0660-4e35-8d91-bfe80088844b] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:06:20.487848 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-3c6a2bb0-e969-4216-85ff-6bbc54d4b9e5 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:06:20.488368 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-3c6a2bb0-e969-4216-85ff-6bbc54d4b9e5 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:06:20.489216 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-3c6a2bb0-e969-4216-85ff-6bbc54d4b9e5 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:06:20.489712 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-3c6a2bb0-e969-4216-85ff-6bbc54d4b9e5 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:06:20.631990 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-da4d3857-934d-4ee2-8734-c23b52837771 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:06:20.633401 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-da4d3857-934d-4ee2-8734-c23b52837771 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] [instance: f5e90100-1612-4e18-b86c-db90e3045760] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:06:20.644112 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-da4d3857-934d-4ee2-8734-c23b52837771 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:06:20.644921 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-da4d3857-934d-4ee2-8734-c23b52837771 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:06:20.646063 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-da4d3857-934d-4ee2-8734-c23b52837771 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:06:20.646559 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-da4d3857-934d-4ee2-8734-c23b52837771 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:06:20.740617 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-3c6a2bb0-e969-4216-85ff-6bbc54d4b9e5 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:06:20.750599 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-3c6a2bb0-e969-4216-85ff-6bbc54d4b9e5 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:06:20.752190 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-3c6a2bb0-e969-4216-85ff-6bbc54d4b9e5 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:06:20.753418 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-3c6a2bb0-e969-4216-85ff-6bbc54d4b9e5 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] 10.222.0.47 "GET /compute/v2.1/servers/dcb11872-0660-4e35-8d91-bfe80088844b" status: 200 len: 1744 microversion: 2.20 time: 0.280797 Feb 19 05:06:20.754036 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 431/851] 10.222.0.47 () {60 vars in 1267 bytes} [Fri Feb 19 05:06:20 2021] GET /compute/v2.1/servers/dcb11872-0660-4e35-8d91-bfe80088844b => generated 1744 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 05:06:20.832488 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-da4d3857-934d-4ee2-8734-c23b52837771 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] 10.222.0.47 "POST /compute/v2.1/servers/f5e90100-1612-4e18-b86c-db90e3045760/action" status: 200 len: 28657 microversion: 2.1 time: 0.204976 Feb 19 05:06:20.833224 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 421/852] 10.222.0.47 () {60 vars in 1268 bytes} [Fri Feb 19 05:06:20 2021] POST /compute/v2.1/servers/f5e90100-1612-4e18-b86c-db90e3045760/action => generated 28657 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 19 05:06:21.378627 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-377f3495-9a22-4e36-96ae-79a05ab77a08 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:06:21.379900 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-377f3495-9a22-4e36-96ae-79a05ab77a08 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] [instance: 0ae0d266-c297-45f1-80fe-0e8f84cc22e6] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:06:21.389670 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-377f3495-9a22-4e36-96ae-79a05ab77a08 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:06:21.390173 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-377f3495-9a22-4e36-96ae-79a05ab77a08 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:06:21.391018 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-377f3495-9a22-4e36-96ae-79a05ab77a08 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:06:21.391559 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-377f3495-9a22-4e36-96ae-79a05ab77a08 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:06:21.465085 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-377f3495-9a22-4e36-96ae-79a05ab77a08 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] 10.222.0.47 "GET /compute/v2.1/servers/0ae0d266-c297-45f1-80fe-0e8f84cc22e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.091689 Feb 19 05:06:21.465545 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 432/853] 10.222.0.47 () {58 vars in 1292 bytes} [Fri Feb 19 05:06:21 2021] GET /compute/v2.1/servers/0ae0d266-c297-45f1-80fe-0e8f84cc22e6/os-volume_attachments => generated 197 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 05:06:21.774873 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-fb20a608-9f49-464c-b66d-27a5693cc208 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:06:21.775687 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-fb20a608-9f49-464c-b66d-27a5693cc208 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] [instance: dcb11872-0660-4e35-8d91-bfe80088844b] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:06:21.785817 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-fb20a608-9f49-464c-b66d-27a5693cc208 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:06:21.786330 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-fb20a608-9f49-464c-b66d-27a5693cc208 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:06:21.787208 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-fb20a608-9f49-464c-b66d-27a5693cc208 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:06:21.787741 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-fb20a608-9f49-464c-b66d-27a5693cc208 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:06:21.852188 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-82c59372-94a0-4c9b-8369-b1d462f1c47f tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:06:21.857846 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-82c59372-94a0-4c9b-8369-b1d462f1c47f tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] [instance: f5e90100-1612-4e18-b86c-db90e3045760] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:06:21.874376 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-82c59372-94a0-4c9b-8369-b1d462f1c47f tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:06:21.875318 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-82c59372-94a0-4c9b-8369-b1d462f1c47f tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:06:21.876527 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-82c59372-94a0-4c9b-8369-b1d462f1c47f tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:06:21.877127 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-82c59372-94a0-4c9b-8369-b1d462f1c47f tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:06:22.019712 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-82c59372-94a0-4c9b-8369-b1d462f1c47f tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] 10.222.0.47 "POST /compute/v2.1/servers/f5e90100-1612-4e18-b86c-db90e3045760/action" status: 200 len: 28657 microversion: 2.1 time: 0.175932 Feb 19 05:06:22.020421 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 433/854] 10.222.0.47 () {60 vars in 1268 bytes} [Fri Feb 19 05:06:21 2021] POST /compute/v2.1/servers/f5e90100-1612-4e18-b86c-db90e3045760/action => generated 28657 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 19 05:06:22.157570 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-fb20a608-9f49-464c-b66d-27a5693cc208 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:06:22.168057 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-fb20a608-9f49-464c-b66d-27a5693cc208 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:06:22.171299 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-fb20a608-9f49-464c-b66d-27a5693cc208 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:06:22.173068 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-fb20a608-9f49-464c-b66d-27a5693cc208 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] 10.222.0.47 "GET /compute/v2.1/servers/dcb11872-0660-4e35-8d91-bfe80088844b" status: 200 len: 1739 microversion: 2.20 time: 0.402670 Feb 19 05:06:22.182017 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 422/855] 10.222.0.47 () {60 vars in 1267 bytes} [Fri Feb 19 05:06:21 2021] GET /compute/v2.1/servers/dcb11872-0660-4e35-8d91-bfe80088844b => generated 1739 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 05:06:22.479555 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-6e1e64ea-2702-4057-9fb1-27b0056939a8 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:06:22.481448 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-6e1e64ea-2702-4057-9fb1-27b0056939a8 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] [instance: 0ae0d266-c297-45f1-80fe-0e8f84cc22e6] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:06:22.491886 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-6e1e64ea-2702-4057-9fb1-27b0056939a8 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:06:22.492406 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-6e1e64ea-2702-4057-9fb1-27b0056939a8 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:06:22.493258 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-6e1e64ea-2702-4057-9fb1-27b0056939a8 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:06:22.494022 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-6e1e64ea-2702-4057-9fb1-27b0056939a8 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:06:22.581295 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-6e1e64ea-2702-4057-9fb1-27b0056939a8 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] 10.222.0.47 "GET /compute/v2.1/servers/0ae0d266-c297-45f1-80fe-0e8f84cc22e6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.106278 Feb 19 05:06:22.582071 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 434/856] 10.222.0.47 () {58 vars in 1292 bytes} [Fri Feb 19 05:06:22 2021] GET /compute/v2.1/servers/0ae0d266-c297-45f1-80fe-0e8f84cc22e6/os-volume_attachments => generated 25 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 19 05:06:22.593265 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-2ece42f3-9979-44ce-82da-e773f7a42e98 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:06:22.594209 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-2ece42f3-9979-44ce-82da-e773f7a42e98 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] [instance: 0ae0d266-c297-45f1-80fe-0e8f84cc22e6] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:06:22.603479 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-2ece42f3-9979-44ce-82da-e773f7a42e98 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:06:22.603981 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-2ece42f3-9979-44ce-82da-e773f7a42e98 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:06:22.604851 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-2ece42f3-9979-44ce-82da-e773f7a42e98 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:06:22.605842 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-2ece42f3-9979-44ce-82da-e773f7a42e98 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:06:22.820253 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.wsgi [None req-2ece42f3-9979-44ce-82da-e773f7a42e98 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] HTTP exception thrown: Instance 0ae0d266-c297-45f1-80fe-0e8f84cc22e6 is not attached to volume 20c7685c-bba3-4282-b9ae-ee918056d0c5 Feb 19 05:06:22.820929 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-2ece42f3-9979-44ce-82da-e773f7a42e98 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Returning 404 to user: Instance 0ae0d266-c297-45f1-80fe-0e8f84cc22e6 is not attached to volume 20c7685c-bba3-4282-b9ae-ee918056d0c5 {{(pid=98153) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 19 05:06:22.821839 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-2ece42f3-9979-44ce-82da-e773f7a42e98 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] 10.222.0.47 "DELETE /compute/v2.1/servers/0ae0d266-c297-45f1-80fe-0e8f84cc22e6/os-volume_attachments/20c7685c-bba3-4282-b9ae-ee918056d0c5" status: 404 len: 154 microversion: 2.1 time: 0.232969 Feb 19 05:06:22.822462 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 423/857] 10.222.0.47 () {58 vars in 1406 bytes} [Fri Feb 19 05:06:22 2021] DELETE /compute/v2.1/servers/0ae0d266-c297-45f1-80fe-0e8f84cc22e6/os-volume_attachments/20c7685c-bba3-4282-b9ae-ee918056d0c5 => generated 154 bytes in 234 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 05:06:23.032954 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-54db6ed4-32ea-4d7b-b322-a52f83b57d24 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:06:23.034470 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-54db6ed4-32ea-4d7b-b322-a52f83b57d24 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] [instance: f5e90100-1612-4e18-b86c-db90e3045760] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:06:23.047436 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-54db6ed4-32ea-4d7b-b322-a52f83b57d24 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:06:23.048276 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-54db6ed4-32ea-4d7b-b322-a52f83b57d24 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:06:23.049647 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-54db6ed4-32ea-4d7b-b322-a52f83b57d24 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:06:23.050400 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-54db6ed4-32ea-4d7b-b322-a52f83b57d24 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:06:23.220910 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-54db6ed4-32ea-4d7b-b322-a52f83b57d24 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] 10.222.0.47 "POST /compute/v2.1/servers/f5e90100-1612-4e18-b86c-db90e3045760/action" status: 200 len: 28657 microversion: 2.1 time: 0.191878 Feb 19 05:06:23.222452 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 435/858] 10.222.0.47 () {60 vars in 1268 bytes} [Fri Feb 19 05:06:23 2021] POST /compute/v2.1/servers/f5e90100-1612-4e18-b86c-db90e3045760/action => generated 28657 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 19 05:06:23.226828 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-0a445d1a-4a6d-4e32-a8ac-de98a729b255 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:06:23.228248 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-0a445d1a-4a6d-4e32-a8ac-de98a729b255 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] [instance: dcb11872-0660-4e35-8d91-bfe80088844b] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:06:23.246490 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-0a445d1a-4a6d-4e32-a8ac-de98a729b255 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:06:23.247045 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-0a445d1a-4a6d-4e32-a8ac-de98a729b255 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:06:23.248715 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-0a445d1a-4a6d-4e32-a8ac-de98a729b255 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:06:23.249455 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-0a445d1a-4a6d-4e32-a8ac-de98a729b255 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:06:23.520425 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-0a445d1a-4a6d-4e32-a8ac-de98a729b255 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:06:23.533957 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-0a445d1a-4a6d-4e32-a8ac-de98a729b255 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:06:23.535669 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-0a445d1a-4a6d-4e32-a8ac-de98a729b255 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:06:23.537213 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-0a445d1a-4a6d-4e32-a8ac-de98a729b255 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] 10.222.0.47 "GET /compute/v2.1/servers/dcb11872-0660-4e35-8d91-bfe80088844b" status: 200 len: 1739 microversion: 2.20 time: 0.325593 Feb 19 05:06:23.537797 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 424/859] 10.222.0.47 () {60 vars in 1267 bytes} [Fri Feb 19 05:06:23 2021] GET /compute/v2.1/servers/dcb11872-0660-4e35-8d91-bfe80088844b => generated 1739 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 05:06:24.160775 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-2c74ac59-3592-4365-aec5-dac62cb45ffa tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:06:24.161422 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-2c74ac59-3592-4365-aec5-dac62cb45ffa tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] [instance: 0ae0d266-c297-45f1-80fe-0e8f84cc22e6] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:06:24.170729 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-2c74ac59-3592-4365-aec5-dac62cb45ffa tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:06:24.171241 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-2c74ac59-3592-4365-aec5-dac62cb45ffa tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:06:24.172124 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-2c74ac59-3592-4365-aec5-dac62cb45ffa tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:06:24.172615 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-2c74ac59-3592-4365-aec5-dac62cb45ffa tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:06:24.235972 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-665e2158-b5c2-414e-be7f-df16f29343e5 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:06:24.237163 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-665e2158-b5c2-414e-be7f-df16f29343e5 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] [instance: f5e90100-1612-4e18-b86c-db90e3045760] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:06:24.242058 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-2c74ac59-3592-4365-aec5-dac62cb45ffa tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] [instance: 0ae0d266-c297-45f1-80fe-0e8f84cc22e6] Going to try to terminate instance {{(pid=98154) delete /opt/stack/nova/nova/compute/api.py:2540}} Feb 19 05:06:24.245430 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-665e2158-b5c2-414e-be7f-df16f29343e5 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:06:24.259452 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-665e2158-b5c2-414e-be7f-df16f29343e5 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:06:24.260859 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-665e2158-b5c2-414e-be7f-df16f29343e5 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:06:24.261792 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-665e2158-b5c2-414e-be7f-df16f29343e5 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:06:24.384539 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-2c74ac59-3592-4365-aec5-dac62cb45ffa tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] 10.222.0.47 "DELETE /compute/v2.1/servers/0ae0d266-c297-45f1-80fe-0e8f84cc22e6" status: 204 len: 0 microversion: 2.1 time: 0.227886 Feb 19 05:06:24.389648 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 436/860] 10.222.0.47 () {58 vars in 1229 bytes} [Fri Feb 19 05:06:24 2021] DELETE /compute/v2.1/servers/0ae0d266-c297-45f1-80fe-0e8f84cc22e6 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Feb 19 05:06:24.395363 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-c5273772-ec6f-4424-9a78-3f0ba3b851fd tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:06:24.397087 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-c5273772-ec6f-4424-9a78-3f0ba3b851fd tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] [instance: 0ae0d266-c297-45f1-80fe-0e8f84cc22e6] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:06:24.407879 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-c5273772-ec6f-4424-9a78-3f0ba3b851fd tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:06:24.408396 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-c5273772-ec6f-4424-9a78-3f0ba3b851fd tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:06:24.409224 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-c5273772-ec6f-4424-9a78-3f0ba3b851fd tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:06:24.409720 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-c5273772-ec6f-4424-9a78-3f0ba3b851fd tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:06:24.455836 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-665e2158-b5c2-414e-be7f-df16f29343e5 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] 10.222.0.47 "POST /compute/v2.1/servers/f5e90100-1612-4e18-b86c-db90e3045760/action" status: 200 len: 28657 microversion: 2.1 time: 0.224540 Feb 19 05:06:24.456782 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 425/861] 10.222.0.47 () {60 vars in 1268 bytes} [Fri Feb 19 05:06:24 2021] POST /compute/v2.1/servers/f5e90100-1612-4e18-b86c-db90e3045760/action => generated 28657 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 19 05:06:24.572734 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-b9f83927-49e0-4008-9d6c-48f2923448f8 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:06:24.573521 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-b9f83927-49e0-4008-9d6c-48f2923448f8 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] [instance: dcb11872-0660-4e35-8d91-bfe80088844b] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:06:24.584792 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-b9f83927-49e0-4008-9d6c-48f2923448f8 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:06:24.585332 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-b9f83927-49e0-4008-9d6c-48f2923448f8 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:06:24.586293 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-b9f83927-49e0-4008-9d6c-48f2923448f8 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:06:24.586796 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-b9f83927-49e0-4008-9d6c-48f2923448f8 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:06:25.110743 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-b9f83927-49e0-4008-9d6c-48f2923448f8 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:06:25.131171 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-c5273772-ec6f-4424-9a78-3f0ba3b851fd tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5df26a2a7e854705800096f12d30c8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3309eb07e18a46a2a0bcbde1f9e46dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:06:25.133958 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-b9f83927-49e0-4008-9d6c-48f2923448f8 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:06:25.136475 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-b9f83927-49e0-4008-9d6c-48f2923448f8 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:06:25.138379 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-b9f83927-49e0-4008-9d6c-48f2923448f8 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] 10.222.0.47 "GET /compute/v2.1/servers/dcb11872-0660-4e35-8d91-bfe80088844b" status: 200 len: 1739 microversion: 2.20 time: 0.570763 Feb 19 05:06:25.139482 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 426/862] 10.222.0.47 () {60 vars in 1267 bytes} [Fri Feb 19 05:06:24 2021] GET /compute/v2.1/servers/dcb11872-0660-4e35-8d91-bfe80088844b => generated 1739 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 05:06:25.147939 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-c5273772-ec6f-4424-9a78-3f0ba3b851fd tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] 10.222.0.47 "GET /compute/v2.1/servers/0ae0d266-c297-45f1-80fe-0e8f84cc22e6" status: 200 len: 1553 microversion: 2.1 time: 0.756439 Feb 19 05:06:25.149306 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 437/863] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:06:24 2021] GET /compute/v2.1/servers/0ae0d266-c297-45f1-80fe-0e8f84cc22e6 => generated 1553 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:06:25.472872 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-6e7c25ed-6c92-4a39-9caf-eee79cf1d426 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:06:25.474086 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-6e7c25ed-6c92-4a39-9caf-eee79cf1d426 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] [instance: f5e90100-1612-4e18-b86c-db90e3045760] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:06:25.483257 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-6e7c25ed-6c92-4a39-9caf-eee79cf1d426 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:06:25.483911 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-6e7c25ed-6c92-4a39-9caf-eee79cf1d426 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:06:25.485011 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-6e7c25ed-6c92-4a39-9caf-eee79cf1d426 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:06:25.485719 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-6e7c25ed-6c92-4a39-9caf-eee79cf1d426 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:06:25.626204 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-6e7c25ed-6c92-4a39-9caf-eee79cf1d426 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] 10.222.0.47 "POST /compute/v2.1/servers/f5e90100-1612-4e18-b86c-db90e3045760/action" status: 200 len: 28657 microversion: 2.1 time: 0.160992 Feb 19 05:06:25.627691 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 427/864] 10.222.0.47 () {60 vars in 1268 bytes} [Fri Feb 19 05:06:25 2021] POST /compute/v2.1/servers/f5e90100-1612-4e18-b86c-db90e3045760/action => generated 28657 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 19 05:06:26.159314 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-51e26d95-4275-4e2c-a2ac-2ee2d2722eed tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:06:26.159924 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-51e26d95-4275-4e2c-a2ac-2ee2d2722eed tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] [instance: dcb11872-0660-4e35-8d91-bfe80088844b] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:06:26.168623 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-51e26d95-4275-4e2c-a2ac-2ee2d2722eed tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:06:26.169126 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-51e26d95-4275-4e2c-a2ac-2ee2d2722eed tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:06:26.171111 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-51e26d95-4275-4e2c-a2ac-2ee2d2722eed tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:06:26.171651 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-51e26d95-4275-4e2c-a2ac-2ee2d2722eed tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:06:26.173638 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-f99f88c4-0485-45db-b587-617d69d058e6 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:06:26.174427 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-f99f88c4-0485-45db-b587-617d69d058e6 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] [instance: 0ae0d266-c297-45f1-80fe-0e8f84cc22e6] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:06:26.183374 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-f99f88c4-0485-45db-b587-617d69d058e6 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:06:26.183886 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-f99f88c4-0485-45db-b587-617d69d058e6 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:06:26.184745 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-f99f88c4-0485-45db-b587-617d69d058e6 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:06:26.185752 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-f99f88c4-0485-45db-b587-617d69d058e6 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:06:26.517682 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-51e26d95-4275-4e2c-a2ac-2ee2d2722eed tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:06:26.526693 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-f99f88c4-0485-45db-b587-617d69d058e6 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5df26a2a7e854705800096f12d30c8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3309eb07e18a46a2a0bcbde1f9e46dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:06:26.536813 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-51e26d95-4275-4e2c-a2ac-2ee2d2722eed tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:06:26.537108 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-f99f88c4-0485-45db-b587-617d69d058e6 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] 10.222.0.47 "GET /compute/v2.1/servers/0ae0d266-c297-45f1-80fe-0e8f84cc22e6" status: 200 len: 1553 microversion: 2.1 time: 0.367946 Feb 19 05:06:26.537848 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 428/865] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:06:26 2021] GET /compute/v2.1/servers/0ae0d266-c297-45f1-80fe-0e8f84cc22e6 => generated 1553 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:06:26.538351 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-51e26d95-4275-4e2c-a2ac-2ee2d2722eed tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:06:26.539844 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-51e26d95-4275-4e2c-a2ac-2ee2d2722eed tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] 10.222.0.47 "GET /compute/v2.1/servers/dcb11872-0660-4e35-8d91-bfe80088844b" status: 200 len: 1739 microversion: 2.20 time: 0.384788 Feb 19 05:06:26.541864 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 438/866] 10.222.0.47 () {60 vars in 1267 bytes} [Fri Feb 19 05:06:26 2021] GET /compute/v2.1/servers/dcb11872-0660-4e35-8d91-bfe80088844b => generated 1739 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 05:06:26.647983 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-084d49fc-d7cd-4306-8167-319df094c3ea tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:06:26.649442 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-084d49fc-d7cd-4306-8167-319df094c3ea tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] [instance: f5e90100-1612-4e18-b86c-db90e3045760] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:06:26.663518 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-084d49fc-d7cd-4306-8167-319df094c3ea tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:06:26.664757 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-084d49fc-d7cd-4306-8167-319df094c3ea tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:06:26.665856 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-084d49fc-d7cd-4306-8167-319df094c3ea tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:06:26.666575 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-084d49fc-d7cd-4306-8167-319df094c3ea tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:06:26.876814 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-084d49fc-d7cd-4306-8167-319df094c3ea tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] 10.222.0.47 "POST /compute/v2.1/servers/f5e90100-1612-4e18-b86c-db90e3045760/action" status: 200 len: 30010 microversion: 2.1 time: 0.240176 Feb 19 05:06:26.878575 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 429/867] 10.222.0.47 () {60 vars in 1268 bytes} [Fri Feb 19 05:06:26 2021] POST /compute/v2.1/servers/f5e90100-1612-4e18-b86c-db90e3045760/action => generated 30010 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 19 05:06:27.130806 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-63857e20-96d1-4947-97fd-b3d125654d06 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1981002784", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1012313419", "security_groups": [{"name": "tempest-TestVolumeBootPattern-1266909124"}], "block_device_mapping_v2": [{"uuid": "c2734bdb-d4ac-4b6f-bd61-5a937f3de60d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "68c8736e-693c-40d6-962b-ec56c71786c4"}]}} {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:06:27.540426 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.network.neutron [None req-63857e20-96d1-4947-97fd-b3d125654d06 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] validate_networks() for [('68c8736e-693c-40d6-962b-ec56c71786c4', None, None, None)] {{(pid=98154) validate_networks /opt/stack/nova/nova/network/neutron.py:2345}} Feb 19 05:06:27.559121 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-00e278b7-d8a0-4a69-8a96-8393b35e7396 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:06:27.560308 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-00e278b7-d8a0-4a69-8a96-8393b35e7396 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] [instance: 0ae0d266-c297-45f1-80fe-0e8f84cc22e6] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:06:27.569260 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-00e278b7-d8a0-4a69-8a96-8393b35e7396 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:06:27.569772 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-00e278b7-d8a0-4a69-8a96-8393b35e7396 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:06:27.570635 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-00e278b7-d8a0-4a69-8a96-8393b35e7396 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:06:27.571130 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-00e278b7-d8a0-4a69-8a96-8393b35e7396 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:06:28.228988 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-00e278b7-d8a0-4a69-8a96-8393b35e7396 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5df26a2a7e854705800096f12d30c8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3309eb07e18a46a2a0bcbde1f9e46dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:06:28.253152 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-00e278b7-d8a0-4a69-8a96-8393b35e7396 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] 10.222.0.47 "GET /compute/v2.1/servers/0ae0d266-c297-45f1-80fe-0e8f84cc22e6" status: 200 len: 1553 microversion: 2.1 time: 0.698609 Feb 19 05:06:28.261140 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 430/868] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:06:27 2021] GET /compute/v2.1/servers/0ae0d266-c297-45f1-80fe-0e8f84cc22e6 => generated 1553 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 05:06:28.271975 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-26f91aae-4c68-46f3-bdae-9842ec12f0eb tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:06:28.276846 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-26f91aae-4c68-46f3-bdae-9842ec12f0eb tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] [instance: dcb11872-0660-4e35-8d91-bfe80088844b] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:06:28.288908 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-26f91aae-4c68-46f3-bdae-9842ec12f0eb tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:06:28.289796 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-26f91aae-4c68-46f3-bdae-9842ec12f0eb tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:06:28.290875 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-26f91aae-4c68-46f3-bdae-9842ec12f0eb tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:06:28.292713 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-26f91aae-4c68-46f3-bdae-9842ec12f0eb tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:06:28.850391 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-26f91aae-4c68-46f3-bdae-9842ec12f0eb tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:06:28.864737 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-26f91aae-4c68-46f3-bdae-9842ec12f0eb tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:06:28.866615 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-26f91aae-4c68-46f3-bdae-9842ec12f0eb tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:06:28.868292 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-26f91aae-4c68-46f3-bdae-9842ec12f0eb tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] 10.222.0.47 "GET /compute/v2.1/servers/dcb11872-0660-4e35-8d91-bfe80088844b" status: 200 len: 1739 microversion: 2.20 time: 0.605478 Feb 19 05:06:28.870433 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 431/869] 10.222.0.47 () {60 vars in 1267 bytes} [Fri Feb 19 05:06:28 2021] GET /compute/v2.1/servers/dcb11872-0660-4e35-8d91-bfe80088844b => generated 1739 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 05:06:28.893162 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-76b973bc-aa06-42da-8fa8-d4139e49b95f tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:06:28.896006 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-76b973bc-aa06-42da-8fa8-d4139e49b95f tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] [instance: f5e90100-1612-4e18-b86c-db90e3045760] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:06:28.927065 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-76b973bc-aa06-42da-8fa8-d4139e49b95f tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:06:28.927915 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-76b973bc-aa06-42da-8fa8-d4139e49b95f tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:06:28.929236 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-76b973bc-aa06-42da-8fa8-d4139e49b95f tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:06:28.930000 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-76b973bc-aa06-42da-8fa8-d4139e49b95f tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:06:29.136964 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-76b973bc-aa06-42da-8fa8-d4139e49b95f tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] 10.222.0.47 "POST /compute/v2.1/servers/f5e90100-1612-4e18-b86c-db90e3045760/action" status: 200 len: 33321 microversion: 2.1 time: 0.254179 Feb 19 05:06:29.144445 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 432/870] 10.222.0.47 () {60 vars in 1268 bytes} [Fri Feb 19 05:06:28 2021] POST /compute/v2.1/servers/f5e90100-1612-4e18-b86c-db90e3045760/action => generated 33321 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 19 05:06:29.150404 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [req-33cd8552-985d-4c94-b8fc-f9430983c229 req-715e7bc1-08a3-45e0-89ad-c5c508d0848e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ae0d266-c297-45f1-80fe-0e8f84cc22e6", "name": "network-vif-deleted", "tag": "fa4d6bd7-26d3-4df0-ac31-ae6f1438d6f5"}]} {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:06:29.152170 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 05:06:29.152170 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: warnings.warn(msg) Feb 19 05:06:29.163984 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [req-33cd8552-985d-4c94-b8fc-f9430983c229 req-715e7bc1-08a3-45e0-89ad-c5c508d0848e service nova] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:06:29.165389 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [req-33cd8552-985d-4c94-b8fc-f9430983c229 req-715e7bc1-08a3-45e0-89ad-c5c508d0848e service nova] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:06:29.182277 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.virt.hardware [None req-63857e20-96d1-4947-97fd-b3d125654d06 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Flavor limits 0:0:0 {{(pid=98154) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 19 05:06:29.182872 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.virt.hardware [None req-63857e20-96d1-4947-97fd-b3d125654d06 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Image limits 0:0:0 {{(pid=98154) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Feb 19 05:06:29.183544 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.virt.hardware [None req-63857e20-96d1-4947-97fd-b3d125654d06 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Flavor pref 0:0:0 {{(pid=98154) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 19 05:06:29.184102 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.virt.hardware [None req-63857e20-96d1-4947-97fd-b3d125654d06 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Image pref 0:0:0 {{(pid=98154) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Feb 19 05:06:29.184656 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.virt.hardware [None req-63857e20-96d1-4947-97fd-b3d125654d06 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98154) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Feb 19 05:06:29.189835 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.compute.server_external_events [req-33cd8552-985d-4c94-b8fc-f9430983c229 req-715e7bc1-08a3-45e0-89ad-c5c508d0848e service nova] Creating event network-vif-deleted:fa4d6bd7-26d3-4df0-ac31-ae6f1438d6f5 for instance 0ae0d266-c297-45f1-80fe-0e8f84cc22e6 on hv-cinder-77642 Feb 19 05:06:29.195372 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [req-33cd8552-985d-4c94-b8fc-f9430983c229 req-715e7bc1-08a3-45e0-89ad-c5c508d0848e service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049237 Feb 19 05:06:29.196392 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-63857e20-96d1-4947-97fd-b3d125654d06 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:06:29.196944 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 433/871] 10.222.0.47 () {64 vars in 1308 bytes} [Fri Feb 19 05:06:29 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 05:06:29.197569 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-63857e20-96d1-4947-97fd-b3d125654d06 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:06:29.198576 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-63857e20-96d1-4947-97fd-b3d125654d06 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:06:29.199075 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-63857e20-96d1-4947-97fd-b3d125654d06 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:06:29.224216 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.quota [None req-63857e20-96d1-4947-97fd-b3d125654d06 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Getting quotas for project f87857a2fc3a4866a8055ed181d12edf. Resources: {'instances', 'ram', 'cores'} {{(pid=98154) _get_quotas /opt/stack/nova/nova/quota.py:388}} Feb 19 05:06:29.229682 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.quota [None req-63857e20-96d1-4947-97fd-b3d125654d06 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Getting quotas for user 32f894b7dad5447688fb395e08d31d4c and project f87857a2fc3a4866a8055ed181d12edf. Resources: {'instances', 'ram', 'cores'} {{(pid=98154) _get_quotas /opt/stack/nova/nova/quota.py:380}} Feb 19 05:06:29.286727 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-c5e7cb04-e90e-4d2e-bdc3-3f5711b57d97 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:06:29.288481 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-c5e7cb04-e90e-4d2e-bdc3-3f5711b57d97 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] [instance: 0ae0d266-c297-45f1-80fe-0e8f84cc22e6] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:06:29.301853 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-c5e7cb04-e90e-4d2e-bdc3-3f5711b57d97 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:06:29.302522 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-c5e7cb04-e90e-4d2e-bdc3-3f5711b57d97 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:06:29.303775 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-c5e7cb04-e90e-4d2e-bdc3-3f5711b57d97 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:06:29.304545 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-c5e7cb04-e90e-4d2e-bdc3-3f5711b57d97 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:06:29.371935 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-63857e20-96d1-4947-97fd-b3d125654d06 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Going to run 1 instances... {{(pid=98154) _provision_instances /opt/stack/nova/nova/compute/api.py:1264}} Feb 19 05:06:29.374593 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-63857e20-96d1-4947-97fd-b3d125654d06 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] [instance: 309f67c8-0c6b-44ba-8084-7af7e889fb60] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c2734bdb-d4ac-4b6f-bd61-5a937f3de60d',volume_size=None,volume_type=None)] {{(pid=98154) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1666}} Feb 19 05:06:29.395305 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-c5e7cb04-e90e-4d2e-bdc3-3f5711b57d97 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:06:29.395903 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-c5e7cb04-e90e-4d2e-bdc3-3f5711b57d97 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:06:29.396502 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.objects.instance [None req-c5e7cb04-e90e-4d2e-bdc3-3f5711b57d97 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Lazy-loading 'fault' on Instance uuid 0ae0d266-c297-45f1-80fe-0e8f84cc22e6 {{(pid=98153) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Feb 19 05:06:29.508458 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-c5e7cb04-e90e-4d2e-bdc3-3f5711b57d97 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5df26a2a7e854705800096f12d30c8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3309eb07e18a46a2a0bcbde1f9e46dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:06:29.519289 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-c5e7cb04-e90e-4d2e-bdc3-3f5711b57d97 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] 10.222.0.47 "GET /compute/v2.1/servers/0ae0d266-c297-45f1-80fe-0e8f84cc22e6" status: 200 len: 1347 microversion: 2.1 time: 0.241166 Feb 19 05:06:29.520318 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 434/872] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:06:29 2021] GET /compute/v2.1/servers/0ae0d266-c297-45f1-80fe-0e8f84cc22e6 => generated 1347 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:06:29.657200 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-63857e20-96d1-4947-97fd-b3d125654d06 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 413 microversion: 2.1 time: 2.530136 Feb 19 05:06:29.666358 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 439/873] 10.222.0.47 () {60 vars in 1137 bytes} [Fri Feb 19 05:06:27 2021] POST /compute/v2.1/servers => generated 413 bytes in 2532 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 19 05:06:29.676715 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-331e65aa-65c6-43b3-a7bd-606dca5f2dee tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:06:29.678239 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-331e65aa-65c6-43b3-a7bd-606dca5f2dee tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] [instance: 309f67c8-0c6b-44ba-8084-7af7e889fb60] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:06:29.847419 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-331e65aa-65c6-43b3-a7bd-606dca5f2dee tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32f894b7dad5447688fb395e08d31d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87857a2fc3a4866a8055ed181d12edf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:06:29.858514 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-331e65aa-65c6-43b3-a7bd-606dca5f2dee tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] 10.222.0.47 "GET /compute/v2.1/servers/309f67c8-0c6b-44ba-8084-7af7e889fb60" status: 200 len: 1095 microversion: 2.1 time: 0.189948 Feb 19 05:06:29.859536 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 435/874] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:06:29 2021] GET /compute/v2.1/servers/309f67c8-0c6b-44ba-8084-7af7e889fb60 => generated 1095 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:06:29.894103 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-bc997087-033c-4501-a496-32dd88962248 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:06:29.894793 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-bc997087-033c-4501-a496-32dd88962248 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] [instance: dcb11872-0660-4e35-8d91-bfe80088844b] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:06:29.904800 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-bc997087-033c-4501-a496-32dd88962248 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:06:29.905307 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-bc997087-033c-4501-a496-32dd88962248 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:06:29.906179 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-bc997087-033c-4501-a496-32dd88962248 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:06:29.906862 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-bc997087-033c-4501-a496-32dd88962248 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:06:30.164835 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-079f0d6f-b0cc-4ee6-ade1-6f41c578f9e3 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:06:30.170633 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-079f0d6f-b0cc-4ee6-ade1-6f41c578f9e3 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] [instance: f5e90100-1612-4e18-b86c-db90e3045760] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:06:30.185155 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-079f0d6f-b0cc-4ee6-ade1-6f41c578f9e3 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:06:30.187272 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-079f0d6f-b0cc-4ee6-ade1-6f41c578f9e3 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:06:30.188695 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-079f0d6f-b0cc-4ee6-ade1-6f41c578f9e3 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:06:30.189766 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-079f0d6f-b0cc-4ee6-ade1-6f41c578f9e3 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:06:30.344688 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-079f0d6f-b0cc-4ee6-ade1-6f41c578f9e3 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] 10.222.0.47 "POST /compute/v2.1/servers/f5e90100-1612-4e18-b86c-db90e3045760/action" status: 200 len: 34436 microversion: 2.1 time: 0.192573 Feb 19 05:06:30.346264 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 436/875] 10.222.0.47 () {60 vars in 1268 bytes} [Fri Feb 19 05:06:30 2021] POST /compute/v2.1/servers/f5e90100-1612-4e18-b86c-db90e3045760/action => generated 34436 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 19 05:06:30.405369 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-bc997087-033c-4501-a496-32dd88962248 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:06:30.423008 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-bc997087-033c-4501-a496-32dd88962248 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:06:30.423008 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-bc997087-033c-4501-a496-32dd88962248 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:06:30.423008 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-bc997087-033c-4501-a496-32dd88962248 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] 10.222.0.47 "GET /compute/v2.1/servers/dcb11872-0660-4e35-8d91-bfe80088844b" status: 200 len: 1739 microversion: 2.20 time: 0.534177 Feb 19 05:06:30.423515 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 440/876] 10.222.0.47 () {60 vars in 1267 bytes} [Fri Feb 19 05:06:29 2021] GET /compute/v2.1/servers/dcb11872-0660-4e35-8d91-bfe80088844b => generated 1739 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 05:06:30.553414 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-76815023-7b86-4677-b093-cbb7e0494927 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:06:30.554184 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-76815023-7b86-4677-b093-cbb7e0494927 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] [instance: 0ae0d266-c297-45f1-80fe-0e8f84cc22e6] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:06:30.579972 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-76815023-7b86-4677-b093-cbb7e0494927 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:06:30.580479 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-76815023-7b86-4677-b093-cbb7e0494927 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:06:30.581346 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-76815023-7b86-4677-b093-cbb7e0494927 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:06:30.581847 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-76815023-7b86-4677-b093-cbb7e0494927 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:06:30.654335 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.wsgi [None req-76815023-7b86-4677-b093-cbb7e0494927 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] HTTP exception thrown: Instance 0ae0d266-c297-45f1-80fe-0e8f84cc22e6 could not be found. Feb 19 05:06:30.655675 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-76815023-7b86-4677-b093-cbb7e0494927 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Returning 404 to user: Instance 0ae0d266-c297-45f1-80fe-0e8f84cc22e6 could not be found. {{(pid=98153) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 19 05:06:30.656996 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-76815023-7b86-4677-b093-cbb7e0494927 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] 10.222.0.47 "GET /compute/v2.1/servers/0ae0d266-c297-45f1-80fe-0e8f84cc22e6" status: 404 len: 111 microversion: 2.1 time: 0.108823 Feb 19 05:06:30.658133 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 437/877] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:06:30 2021] GET /compute/v2.1/servers/0ae0d266-c297-45f1-80fe-0e8f84cc22e6 => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 05:06:30.667922 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-4bc186cb-7366-47e9-91a4-26cc17277a40 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] Calling method '.version_select at 0x7f27073140d0>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:06:30.688740 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-4bc186cb-7366-47e9-91a4-26cc17277a40 tempest-TestMinimumBasicScenario-1378541111 tempest-TestMinimumBasicScenario-1378541111-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1088231285" status: 202 len: 0 microversion: 2.1 time: 0.024879 Feb 19 05:06:30.689667 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 441/878] 10.222.0.47 () {58 vars in 1262 bytes} [Fri Feb 19 05:06:30 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1088231285 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 19 05:06:30.877896 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-f77def6f-bec9-4067-8304-f02561f37edc tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:06:30.878663 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-f77def6f-bec9-4067-8304-f02561f37edc tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] [instance: 309f67c8-0c6b-44ba-8084-7af7e889fb60] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:06:30.899012 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-f77def6f-bec9-4067-8304-f02561f37edc tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:06:30.899571 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-f77def6f-bec9-4067-8304-f02561f37edc tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:06:30.900612 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-f77def6f-bec9-4067-8304-f02561f37edc tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:06:30.907197 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-f77def6f-bec9-4067-8304-f02561f37edc tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:06:31.121818 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-f77def6f-bec9-4067-8304-f02561f37edc tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32f894b7dad5447688fb395e08d31d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87857a2fc3a4866a8055ed181d12edf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:06:31.131955 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-f77def6f-bec9-4067-8304-f02561f37edc tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] 10.222.0.47 "GET /compute/v2.1/servers/309f67c8-0c6b-44ba-8084-7af7e889fb60" status: 200 len: 1193 microversion: 2.1 time: 0.259295 Feb 19 05:06:31.132694 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 438/879] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:06:30 2021] GET /compute/v2.1/servers/309f67c8-0c6b-44ba-8084-7af7e889fb60 => generated 1193 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:06:31.360889 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-d4cd8101-57e4-4a52-bec8-1a9d2eff7db9 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:06:31.362140 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-d4cd8101-57e4-4a52-bec8-1a9d2eff7db9 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] [instance: f5e90100-1612-4e18-b86c-db90e3045760] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:06:31.378617 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-d4cd8101-57e4-4a52-bec8-1a9d2eff7db9 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:06:31.388159 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-d4cd8101-57e4-4a52-bec8-1a9d2eff7db9 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:06:31.389348 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-d4cd8101-57e4-4a52-bec8-1a9d2eff7db9 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:06:31.390510 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-d4cd8101-57e4-4a52-bec8-1a9d2eff7db9 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:06:31.455681 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-53b18b26-d1d1-4c2e-ac30-89af36eb7731 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:06:31.456713 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-53b18b26-d1d1-4c2e-ac30-89af36eb7731 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] [instance: dcb11872-0660-4e35-8d91-bfe80088844b] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:06:31.492217 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-53b18b26-d1d1-4c2e-ac30-89af36eb7731 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:06:31.493033 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-53b18b26-d1d1-4c2e-ac30-89af36eb7731 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:06:31.504528 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-53b18b26-d1d1-4c2e-ac30-89af36eb7731 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:06:31.505690 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-53b18b26-d1d1-4c2e-ac30-89af36eb7731 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:06:31.709201 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-d4cd8101-57e4-4a52-bec8-1a9d2eff7db9 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] 10.222.0.47 "POST /compute/v2.1/servers/f5e90100-1612-4e18-b86c-db90e3045760/action" status: 200 len: 35767 microversion: 2.1 time: 0.353157 Feb 19 05:06:31.710999 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 442/880] 10.222.0.47 () {60 vars in 1268 bytes} [Fri Feb 19 05:06:31 2021] POST /compute/v2.1/servers/f5e90100-1612-4e18-b86c-db90e3045760/action => generated 35767 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 19 05:06:32.153261 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-476391bb-23c3-4346-9c57-cba357c3b0fb tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:06:32.155194 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-476391bb-23c3-4346-9c57-cba357c3b0fb tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] [instance: 309f67c8-0c6b-44ba-8084-7af7e889fb60] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:06:32.173786 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-476391bb-23c3-4346-9c57-cba357c3b0fb tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:06:32.174684 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-476391bb-23c3-4346-9c57-cba357c3b0fb tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:06:32.176019 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-476391bb-23c3-4346-9c57-cba357c3b0fb tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:06:32.176915 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-476391bb-23c3-4346-9c57-cba357c3b0fb tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:06:32.282046 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-53b18b26-d1d1-4c2e-ac30-89af36eb7731 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:06:32.295354 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-53b18b26-d1d1-4c2e-ac30-89af36eb7731 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:06:32.297064 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-53b18b26-d1d1-4c2e-ac30-89af36eb7731 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:06:32.298536 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-53b18b26-d1d1-4c2e-ac30-89af36eb7731 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] 10.222.0.47 "GET /compute/v2.1/servers/dcb11872-0660-4e35-8d91-bfe80088844b" status: 200 len: 1739 microversion: 2.20 time: 0.848171 Feb 19 05:06:32.310292 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 439/881] 10.222.0.47 () {60 vars in 1267 bytes} [Fri Feb 19 05:06:31 2021] GET /compute/v2.1/servers/dcb11872-0660-4e35-8d91-bfe80088844b => generated 1739 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 05:06:32.381895 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-476391bb-23c3-4346-9c57-cba357c3b0fb tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32f894b7dad5447688fb395e08d31d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87857a2fc3a4866a8055ed181d12edf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:06:32.397343 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-476391bb-23c3-4346-9c57-cba357c3b0fb tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] 10.222.0.47 "GET /compute/v2.1/servers/309f67c8-0c6b-44ba-8084-7af7e889fb60" status: 200 len: 1211 microversion: 2.1 time: 0.249305 Feb 19 05:06:32.405971 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 443/882] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:06:32 2021] GET /compute/v2.1/servers/309f67c8-0c6b-44ba-8084-7af7e889fb60 => generated 1211 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 05:06:32.725432 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-1fab7c1b-0358-41c0-8238-833780b74598 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:06:32.726568 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-1fab7c1b-0358-41c0-8238-833780b74598 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] [instance: f5e90100-1612-4e18-b86c-db90e3045760] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:06:32.741584 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-1fab7c1b-0358-41c0-8238-833780b74598 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:06:32.745813 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-1fab7c1b-0358-41c0-8238-833780b74598 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:06:32.750366 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-1fab7c1b-0358-41c0-8238-833780b74598 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:06:32.751001 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-1fab7c1b-0358-41c0-8238-833780b74598 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:06:32.983659 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-1fab7c1b-0358-41c0-8238-833780b74598 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] 10.222.0.47 "POST /compute/v2.1/servers/f5e90100-1612-4e18-b86c-db90e3045760/action" status: 200 len: 37604 microversion: 2.1 time: 0.264051 Feb 19 05:06:32.984370 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 440/883] 10.222.0.47 () {60 vars in 1268 bytes} [Fri Feb 19 05:06:32 2021] POST /compute/v2.1/servers/f5e90100-1612-4e18-b86c-db90e3045760/action => generated 37604 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 19 05:06:33.318441 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-606aafa3-247a-4f3e-b167-e56615de622e tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:06:33.319315 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-606aafa3-247a-4f3e-b167-e56615de622e tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] [instance: dcb11872-0660-4e35-8d91-bfe80088844b] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:06:33.333485 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-606aafa3-247a-4f3e-b167-e56615de622e tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:06:33.343982 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-606aafa3-247a-4f3e-b167-e56615de622e tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:06:33.345261 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-606aafa3-247a-4f3e-b167-e56615de622e tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:06:33.345973 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-606aafa3-247a-4f3e-b167-e56615de622e tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:06:33.428269 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-31638e4d-a8a2-4272-b23b-51401270429a tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:06:33.429721 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-31638e4d-a8a2-4272-b23b-51401270429a tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] [instance: 309f67c8-0c6b-44ba-8084-7af7e889fb60] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:06:33.448153 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-31638e4d-a8a2-4272-b23b-51401270429a tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:06:33.448918 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-31638e4d-a8a2-4272-b23b-51401270429a tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:06:33.451182 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-31638e4d-a8a2-4272-b23b-51401270429a tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:06:33.452675 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-31638e4d-a8a2-4272-b23b-51401270429a tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:06:34.009682 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-606aafa3-247a-4f3e-b167-e56615de622e tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:06:34.017314 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-31638e4d-a8a2-4272-b23b-51401270429a tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32f894b7dad5447688fb395e08d31d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87857a2fc3a4866a8055ed181d12edf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:06:34.026681 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-606aafa3-247a-4f3e-b167-e56615de622e tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:06:34.032746 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-606aafa3-247a-4f3e-b167-e56615de622e tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:06:34.035719 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-31638e4d-a8a2-4272-b23b-51401270429a tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] 10.222.0.47 "GET /compute/v2.1/servers/309f67c8-0c6b-44ba-8084-7af7e889fb60" status: 200 len: 1274 microversion: 2.1 time: 0.614237 Feb 19 05:06:34.035846 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-606aafa3-247a-4f3e-b167-e56615de622e tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] 10.222.0.47 "GET /compute/v2.1/servers/dcb11872-0660-4e35-8d91-bfe80088844b" status: 200 len: 1739 microversion: 2.20 time: 0.721581 Feb 19 05:06:34.036416 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 444/884] 10.222.0.47 () {60 vars in 1267 bytes} [Fri Feb 19 05:06:33 2021] GET /compute/v2.1/servers/dcb11872-0660-4e35-8d91-bfe80088844b => generated 1739 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 05:06:34.037587 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 441/885] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:06:33 2021] GET /compute/v2.1/servers/309f67c8-0c6b-44ba-8084-7af7e889fb60 => generated 1274 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:06:34.043515 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-afb38c18-b583-43b9-ab3d-d1bd4599f490 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:06:34.045133 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-afb38c18-b583-43b9-ab3d-d1bd4599f490 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] [instance: f5e90100-1612-4e18-b86c-db90e3045760] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:06:34.061526 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-afb38c18-b583-43b9-ab3d-d1bd4599f490 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:06:34.062045 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-afb38c18-b583-43b9-ab3d-d1bd4599f490 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:06:34.062933 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-afb38c18-b583-43b9-ab3d-d1bd4599f490 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:06:34.063457 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-afb38c18-b583-43b9-ab3d-d1bd4599f490 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:06:34.253606 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-afb38c18-b583-43b9-ab3d-d1bd4599f490 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] 10.222.0.47 "POST /compute/v2.1/servers/f5e90100-1612-4e18-b86c-db90e3045760/action" status: 200 len: 38187 microversion: 2.1 time: 0.214574 Feb 19 05:06:34.254661 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 442/886] 10.222.0.47 () {60 vars in 1268 bytes} [Fri Feb 19 05:06:34 2021] POST /compute/v2.1/servers/f5e90100-1612-4e18-b86c-db90e3045760/action => generated 38187 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 19 05:06:35.063409 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-99e6a2ea-dfbb-408a-b497-fa6441474e52 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:06:35.064714 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-99e6a2ea-dfbb-408a-b497-fa6441474e52 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] [instance: dcb11872-0660-4e35-8d91-bfe80088844b] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:06:35.065725 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-747c87e4-1fd2-4c24-8282-cdeee0731e17 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:06:35.066506 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-747c87e4-1fd2-4c24-8282-cdeee0731e17 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] [instance: 309f67c8-0c6b-44ba-8084-7af7e889fb60] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:06:35.074573 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-99e6a2ea-dfbb-408a-b497-fa6441474e52 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:06:35.075988 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-99e6a2ea-dfbb-408a-b497-fa6441474e52 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:06:35.077245 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-99e6a2ea-dfbb-408a-b497-fa6441474e52 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:06:35.078449 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-99e6a2ea-dfbb-408a-b497-fa6441474e52 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:06:35.081394 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-747c87e4-1fd2-4c24-8282-cdeee0731e17 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:06:35.083100 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-747c87e4-1fd2-4c24-8282-cdeee0731e17 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:06:35.084354 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-747c87e4-1fd2-4c24-8282-cdeee0731e17 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:06:35.085000 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-747c87e4-1fd2-4c24-8282-cdeee0731e17 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:06:35.546150 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-99e6a2ea-dfbb-408a-b497-fa6441474e52 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:06:35.560483 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-99e6a2ea-dfbb-408a-b497-fa6441474e52 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:06:35.564331 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-99e6a2ea-dfbb-408a-b497-fa6441474e52 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:06:35.566354 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-99e6a2ea-dfbb-408a-b497-fa6441474e52 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] 10.222.0.47 "GET /compute/v2.1/servers/dcb11872-0660-4e35-8d91-bfe80088844b" status: 200 len: 1721 microversion: 2.20 time: 0.509347 Feb 19 05:06:35.579315 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 445/887] 10.222.0.47 () {60 vars in 1267 bytes} [Fri Feb 19 05:06:35 2021] GET /compute/v2.1/servers/dcb11872-0660-4e35-8d91-bfe80088844b => generated 1721 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 05:06:35.584976 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-c6952a38-8c01-4536-a1cb-a5b825e7349d tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:06:35.586273 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-c6952a38-8c01-4536-a1cb-a5b825e7349d tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] [instance: f5e90100-1612-4e18-b86c-db90e3045760] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:06:35.595645 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-c6952a38-8c01-4536-a1cb-a5b825e7349d tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:06:35.596418 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-c6952a38-8c01-4536-a1cb-a5b825e7349d tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:06:35.597900 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-c6952a38-8c01-4536-a1cb-a5b825e7349d tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:06:35.598583 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-c6952a38-8c01-4536-a1cb-a5b825e7349d tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:06:35.639442 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-747c87e4-1fd2-4c24-8282-cdeee0731e17 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32f894b7dad5447688fb395e08d31d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87857a2fc3a4866a8055ed181d12edf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:06:35.650463 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-747c87e4-1fd2-4c24-8282-cdeee0731e17 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] 10.222.0.47 "GET /compute/v2.1/servers/309f67c8-0c6b-44ba-8084-7af7e889fb60" status: 200 len: 1274 microversion: 2.1 time: 0.589364 Feb 19 05:06:35.651105 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 443/888] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:06:35 2021] GET /compute/v2.1/servers/309f67c8-0c6b-44ba-8084-7af7e889fb60 => generated 1274 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:06:35.743416 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-c6952a38-8c01-4536-a1cb-a5b825e7349d tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] 10.222.0.47 "POST /compute/v2.1/servers/f5e90100-1612-4e18-b86c-db90e3045760/action" status: 200 len: 38187 microversion: 2.1 time: 0.161990 Feb 19 05:06:35.744393 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 446/889] 10.222.0.47 () {60 vars in 1268 bytes} [Fri Feb 19 05:06:35 2021] POST /compute/v2.1/servers/f5e90100-1612-4e18-b86c-db90e3045760/action => generated 38187 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 19 05:06:36.132098 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [req-3189ab0d-d488-4de5-acbb-183942f57848 req-fe9afc13-e073-4bd6-b298-b6d064bd6a4f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "309f67c8-0c6b-44ba-8084-7af7e889fb60", "tag": "a7ea70c1-0ec6-4ca5-a043-58240dd4372b"}]} {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:06:36.135370 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 05:06:36.135370 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: warnings.warn(msg) Feb 19 05:06:36.148316 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [req-3189ab0d-d488-4de5-acbb-183942f57848 req-fe9afc13-e073-4bd6-b298-b6d064bd6a4f service nova] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:06:36.149074 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [req-3189ab0d-d488-4de5-acbb-183942f57848 req-fe9afc13-e073-4bd6-b298-b6d064bd6a4f service nova] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:06:36.172642 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.compute.server_external_events [req-3189ab0d-d488-4de5-acbb-183942f57848 req-fe9afc13-e073-4bd6-b298-b6d064bd6a4f service nova] Creating event network-changed:a7ea70c1-0ec6-4ca5-a043-58240dd4372b for instance 309f67c8-0c6b-44ba-8084-7af7e889fb60 on hv-cinder-77642 Feb 19 05:06:36.201357 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [req-3189ab0d-d488-4de5-acbb-183942f57848 req-fe9afc13-e073-4bd6-b298-b6d064bd6a4f service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079481 Feb 19 05:06:36.202303 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 444/890] 10.222.0.47 () {64 vars in 1308 bytes} [Fri Feb 19 05:06:36 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 05:06:36.587424 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-a5cd9b4f-e73e-458d-8b69-0a8921d7a51e tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:06:36.588545 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-a5cd9b4f-e73e-458d-8b69-0a8921d7a51e tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] [instance: dcb11872-0660-4e35-8d91-bfe80088844b] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:06:36.598941 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-a5cd9b4f-e73e-458d-8b69-0a8921d7a51e tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:06:36.599791 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-a5cd9b4f-e73e-458d-8b69-0a8921d7a51e tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:06:36.600840 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-a5cd9b4f-e73e-458d-8b69-0a8921d7a51e tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:06:36.601509 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-a5cd9b4f-e73e-458d-8b69-0a8921d7a51e tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:06:36.670326 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-9a636c56-3dac-48aa-b8a1-ddef92bb93cf tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:06:36.673680 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-9a636c56-3dac-48aa-b8a1-ddef92bb93cf tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] [instance: 309f67c8-0c6b-44ba-8084-7af7e889fb60] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:06:36.683973 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-9a636c56-3dac-48aa-b8a1-ddef92bb93cf tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:06:36.685504 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-9a636c56-3dac-48aa-b8a1-ddef92bb93cf tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:06:36.686582 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-9a636c56-3dac-48aa-b8a1-ddef92bb93cf tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:06:36.687241 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-9a636c56-3dac-48aa-b8a1-ddef92bb93cf tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:06:37.184938 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-a5cd9b4f-e73e-458d-8b69-0a8921d7a51e tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:06:37.196919 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-9a636c56-3dac-48aa-b8a1-ddef92bb93cf tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32f894b7dad5447688fb395e08d31d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87857a2fc3a4866a8055ed181d12edf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:06:37.198152 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-a5cd9b4f-e73e-458d-8b69-0a8921d7a51e tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:06:37.199935 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-a5cd9b4f-e73e-458d-8b69-0a8921d7a51e tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:06:37.202442 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-a5cd9b4f-e73e-458d-8b69-0a8921d7a51e tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] 10.222.0.47 "GET /compute/v2.1/servers/dcb11872-0660-4e35-8d91-bfe80088844b" status: 200 len: 1721 microversion: 2.20 time: 0.619540 Feb 19 05:06:37.203422 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 447/891] 10.222.0.47 () {60 vars in 1267 bytes} [Fri Feb 19 05:06:36 2021] GET /compute/v2.1/servers/dcb11872-0660-4e35-8d91-bfe80088844b => generated 1721 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 05:06:37.208163 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-9a636c56-3dac-48aa-b8a1-ddef92bb93cf tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] 10.222.0.47 "GET /compute/v2.1/servers/309f67c8-0c6b-44ba-8084-7af7e889fb60" status: 200 len: 1274 microversion: 2.1 time: 0.542619 Feb 19 05:06:37.208531 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-8119d3d5-6b75-4467-b5cf-d6d98f953c40 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:06:37.208996 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 445/892] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:06:36 2021] GET /compute/v2.1/servers/309f67c8-0c6b-44ba-8084-7af7e889fb60 => generated 1274 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:06:37.219269 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-8119d3d5-6b75-4467-b5cf-d6d98f953c40 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] [instance: f5e90100-1612-4e18-b86c-db90e3045760] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:06:37.219269 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-8119d3d5-6b75-4467-b5cf-d6d98f953c40 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:06:37.219269 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-8119d3d5-6b75-4467-b5cf-d6d98f953c40 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:06:37.220617 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-8119d3d5-6b75-4467-b5cf-d6d98f953c40 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:06:37.221221 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-8119d3d5-6b75-4467-b5cf-d6d98f953c40 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:06:37.374204 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-8119d3d5-6b75-4467-b5cf-d6d98f953c40 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] 10.222.0.47 "POST /compute/v2.1/servers/f5e90100-1612-4e18-b86c-db90e3045760/action" status: 200 len: 38187 microversion: 2.1 time: 0.169418 Feb 19 05:06:37.375757 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 448/893] 10.222.0.47 () {60 vars in 1268 bytes} [Fri Feb 19 05:06:37 2021] POST /compute/v2.1/servers/f5e90100-1612-4e18-b86c-db90e3045760/action => generated 38187 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 19 05:06:38.225650 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-3b0c0394-e4b2-44da-9a85-c5f29a6d7404 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:06:38.226584 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-3b0c0394-e4b2-44da-9a85-c5f29a6d7404 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] [instance: dcb11872-0660-4e35-8d91-bfe80088844b] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:06:38.227229 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-e3fcac2b-5937-4548-9121-2f2c64c88ca6 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:06:38.228206 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-e3fcac2b-5937-4548-9121-2f2c64c88ca6 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] [instance: 309f67c8-0c6b-44ba-8084-7af7e889fb60] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:06:38.235568 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-3b0c0394-e4b2-44da-9a85-c5f29a6d7404 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:06:38.236054 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-3b0c0394-e4b2-44da-9a85-c5f29a6d7404 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:06:38.236909 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-3b0c0394-e4b2-44da-9a85-c5f29a6d7404 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:06:38.237395 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-3b0c0394-e4b2-44da-9a85-c5f29a6d7404 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:06:38.245049 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-e3fcac2b-5937-4548-9121-2f2c64c88ca6 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:06:38.245049 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-e3fcac2b-5937-4548-9121-2f2c64c88ca6 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:06:38.245049 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-e3fcac2b-5937-4548-9121-2f2c64c88ca6 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:06:38.245049 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-e3fcac2b-5937-4548-9121-2f2c64c88ca6 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:06:38.578374 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-3b0c0394-e4b2-44da-9a85-c5f29a6d7404 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:06:38.580750 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-e3fcac2b-5937-4548-9121-2f2c64c88ca6 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32f894b7dad5447688fb395e08d31d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87857a2fc3a4866a8055ed181d12edf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:06:38.590551 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-e3fcac2b-5937-4548-9121-2f2c64c88ca6 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] 10.222.0.47 "GET /compute/v2.1/servers/309f67c8-0c6b-44ba-8084-7af7e889fb60" status: 200 len: 1274 microversion: 2.1 time: 0.367971 Feb 19 05:06:38.592164 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 449/894] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:06:38 2021] GET /compute/v2.1/servers/309f67c8-0c6b-44ba-8084-7af7e889fb60 => generated 1274 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 05:06:38.592932 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-3b0c0394-e4b2-44da-9a85-c5f29a6d7404 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:06:38.596175 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-3b0c0394-e4b2-44da-9a85-c5f29a6d7404 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:06:38.597076 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-3da573c0-c0f5-4200-bf7b-5f8211c3645c tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:06:38.597977 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-3b0c0394-e4b2-44da-9a85-c5f29a6d7404 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] 10.222.0.47 "GET /compute/v2.1/servers/dcb11872-0660-4e35-8d91-bfe80088844b" status: 200 len: 1721 microversion: 2.20 time: 0.379348 Feb 19 05:06:38.598112 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-3da573c0-c0f5-4200-bf7b-5f8211c3645c tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] [instance: f5e90100-1612-4e18-b86c-db90e3045760] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:06:38.598861 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 446/895] 10.222.0.47 () {60 vars in 1267 bytes} [Fri Feb 19 05:06:38 2021] GET /compute/v2.1/servers/dcb11872-0660-4e35-8d91-bfe80088844b => generated 1721 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 05:06:38.606358 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-3da573c0-c0f5-4200-bf7b-5f8211c3645c tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:06:38.607185 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-3da573c0-c0f5-4200-bf7b-5f8211c3645c tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:06:38.608283 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-3da573c0-c0f5-4200-bf7b-5f8211c3645c tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:06:38.608970 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-3da573c0-c0f5-4200-bf7b-5f8211c3645c tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:06:38.751667 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-3da573c0-c0f5-4200-bf7b-5f8211c3645c tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] 10.222.0.47 "POST /compute/v2.1/servers/f5e90100-1612-4e18-b86c-db90e3045760/action" status: 200 len: 38316 microversion: 2.1 time: 0.157986 Feb 19 05:06:38.753064 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 450/896] 10.222.0.47 () {60 vars in 1268 bytes} [Fri Feb 19 05:06:38 2021] POST /compute/v2.1/servers/f5e90100-1612-4e18-b86c-db90e3045760/action => generated 38316 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 19 05:06:38.765067 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-d0ea540a-1b5b-4981-8bb0-9b3f91dd6a99 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:06:38.765703 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-d0ea540a-1b5b-4981-8bb0-9b3f91dd6a99 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] [instance: f5e90100-1612-4e18-b86c-db90e3045760] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:06:38.774279 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-d0ea540a-1b5b-4981-8bb0-9b3f91dd6a99 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:06:38.774913 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-d0ea540a-1b5b-4981-8bb0-9b3f91dd6a99 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:06:38.775904 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-d0ea540a-1b5b-4981-8bb0-9b3f91dd6a99 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:06:38.776640 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-d0ea540a-1b5b-4981-8bb0-9b3f91dd6a99 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:06:38.853121 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-d0ea540a-1b5b-4981-8bb0-9b3f91dd6a99 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] 10.222.0.47 "GET /compute/v2.1/servers/f5e90100-1612-4e18-b86c-db90e3045760/ips" status: 200 len: 147 microversion: 2.1 time: 0.092841 Feb 19 05:06:38.853989 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 447/897] 10.222.0.47 () {58 vars in 1238 bytes} [Fri Feb 19 05:06:38 2021] GET /compute/v2.1/servers/f5e90100-1612-4e18-b86c-db90e3045760/ips => generated 147 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 05:06:39.610185 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-edf921a9-d92d-4f01-945f-97a2b20d58a4 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:06:39.611058 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-edf921a9-d92d-4f01-945f-97a2b20d58a4 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] [instance: 309f67c8-0c6b-44ba-8084-7af7e889fb60] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:06:39.620305 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-edf921a9-d92d-4f01-945f-97a2b20d58a4 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:06:39.621041 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-edf921a9-d92d-4f01-945f-97a2b20d58a4 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:06:39.622043 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-edf921a9-d92d-4f01-945f-97a2b20d58a4 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:06:39.622773 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-6c3042d1-0f37-44bc-981b-542fdd64cc2d tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:06:39.623352 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-edf921a9-d92d-4f01-945f-97a2b20d58a4 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:06:39.623568 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-6c3042d1-0f37-44bc-981b-542fdd64cc2d tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] [instance: dcb11872-0660-4e35-8d91-bfe80088844b] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:06:39.631905 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-6c3042d1-0f37-44bc-981b-542fdd64cc2d tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:06:39.632422 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-6c3042d1-0f37-44bc-981b-542fdd64cc2d tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:06:39.633278 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-6c3042d1-0f37-44bc-981b-542fdd64cc2d tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:06:39.633778 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-6c3042d1-0f37-44bc-981b-542fdd64cc2d tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:06:39.976061 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-6c3042d1-0f37-44bc-981b-542fdd64cc2d tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:06:39.988510 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-edf921a9-d92d-4f01-945f-97a2b20d58a4 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32f894b7dad5447688fb395e08d31d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87857a2fc3a4866a8055ed181d12edf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:06:39.999096 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-6c3042d1-0f37-44bc-981b-542fdd64cc2d tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:06:40.004143 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-edf921a9-d92d-4f01-945f-97a2b20d58a4 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] 10.222.0.47 "GET /compute/v2.1/servers/309f67c8-0c6b-44ba-8084-7af7e889fb60" status: 200 len: 1274 microversion: 2.1 time: 0.398684 Feb 19 05:06:40.004991 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 451/898] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:06:39 2021] GET /compute/v2.1/servers/309f67c8-0c6b-44ba-8084-7af7e889fb60 => generated 1274 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:06:40.010878 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-6c3042d1-0f37-44bc-981b-542fdd64cc2d tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:06:40.012852 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-6c3042d1-0f37-44bc-981b-542fdd64cc2d tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] 10.222.0.47 "GET /compute/v2.1/servers/dcb11872-0660-4e35-8d91-bfe80088844b" status: 200 len: 1664 microversion: 2.20 time: 0.394987 Feb 19 05:06:40.014096 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 448/899] 10.222.0.47 () {60 vars in 1267 bytes} [Fri Feb 19 05:06:39 2021] GET /compute/v2.1/servers/dcb11872-0660-4e35-8d91-bfe80088844b => generated 1664 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 05:06:40.030215 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [req-2c04ea81-3fb8-468c-8da5-06aa5a227e92 req-1d6d2ae3-e2c7-41c3-b8b8-24f1cbc588b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dcb11872-0660-4e35-8d91-bfe80088844b", "name": "network-vif-unplugged", "status": "completed", "tag": "02a5dd6b-46b0-46bc-b05b-eb9f66823a35"}]} {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:06:40.032381 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 05:06:40.032381 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: warnings.warn(msg) Feb 19 05:06:40.042206 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [req-2c04ea81-3fb8-468c-8da5-06aa5a227e92 req-1d6d2ae3-e2c7-41c3-b8b8-24f1cbc588b5 service nova] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:06:40.043093 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [req-2c04ea81-3fb8-468c-8da5-06aa5a227e92 req-1d6d2ae3-e2c7-41c3-b8b8-24f1cbc588b5 service nova] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:06:40.056841 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-baef89a6-b5e2-43a8-b1dc-43b3f70fb6ae tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d0ed7a52-97e1-4528-b7d5-eaa1128aed6b"}} {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:06:40.058624 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-baef89a6-b5e2-43a8-b1dc-43b3f70fb6ae tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] [instance: dcb11872-0660-4e35-8d91-bfe80088844b] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:06:40.065242 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.compute.server_external_events [req-2c04ea81-3fb8-468c-8da5-06aa5a227e92 req-1d6d2ae3-e2c7-41c3-b8b8-24f1cbc588b5 service nova] Unable to find a host for instance dcb11872-0660-4e35-8d91-bfe80088844b. Dropping event network-vif-unplugged {{(pid=98154) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:141}} Feb 19 05:06:40.069366 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-baef89a6-b5e2-43a8-b1dc-43b3f70fb6ae tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:06:40.070398 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-baef89a6-b5e2-43a8-b1dc-43b3f70fb6ae tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:06:40.071728 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-baef89a6-b5e2-43a8-b1dc-43b3f70fb6ae tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:06:40.072435 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-baef89a6-b5e2-43a8-b1dc-43b3f70fb6ae tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:06:40.077125 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [req-2c04ea81-3fb8-468c-8da5-06aa5a227e92 req-1d6d2ae3-e2c7-41c3-b8b8-24f1cbc588b5 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.049406 Feb 19 05:06:40.078063 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 452/900] 10.222.0.47 () {64 vars in 1308 bytes} [Fri Feb 19 05:06:40 2021] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 73 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Feb 19 05:06:40.563015 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-9254ad1a-4721-4472-9e09-48f8e41b18c1 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "17b5dc6e-bd46-48bc-969e-b08d0f1f003d"}} {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:06:40.564424 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-9254ad1a-4721-4472-9e09-48f8e41b18c1 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] [instance: f5e90100-1612-4e18-b86c-db90e3045760] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:06:40.566145 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-baef89a6-b5e2-43a8-b1dc-43b3f70fb6ae tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] 10.222.0.47 "POST /compute/v2.1/servers/dcb11872-0660-4e35-8d91-bfe80088844b/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.513930 Feb 19 05:06:40.566400 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 449/901] 10.222.0.47 () {62 vars in 1354 bytes} [Fri Feb 19 05:06:40 2021] POST /compute/v2.1/servers/dcb11872-0660-4e35-8d91-bfe80088844b/os-volume_attachments => generated 188 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 19 05:06:40.584689 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-9254ad1a-4721-4472-9e09-48f8e41b18c1 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:06:40.585625 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-9254ad1a-4721-4472-9e09-48f8e41b18c1 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:06:40.587166 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-9254ad1a-4721-4472-9e09-48f8e41b18c1 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:06:40.588086 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-9254ad1a-4721-4472-9e09-48f8e41b18c1 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:06:40.696220 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-5e5806e2-b2aa-43f6-a3be-96015303b4ab tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:06:40.696748 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-5e5806e2-b2aa-43f6-a3be-96015303b4ab tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] [instance: dcb11872-0660-4e35-8d91-bfe80088844b] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:06:40.705632 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-5e5806e2-b2aa-43f6-a3be-96015303b4ab tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:06:40.706318 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-5e5806e2-b2aa-43f6-a3be-96015303b4ab tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:06:40.706982 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-5e5806e2-b2aa-43f6-a3be-96015303b4ab tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:06:40.707686 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-5e5806e2-b2aa-43f6-a3be-96015303b4ab tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:06:41.068707 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-9254ad1a-4721-4472-9e09-48f8e41b18c1 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] 10.222.0.47 "POST /compute/v2.1/servers/f5e90100-1612-4e18-b86c-db90e3045760/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.511722 Feb 19 05:06:41.069586 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 453/902] 10.222.0.47 () {60 vars in 1313 bytes} [Fri Feb 19 05:06:40 2021] POST /compute/v2.1/servers/f5e90100-1612-4e18-b86c-db90e3045760/os-volume_attachments => generated 194 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 05:06:41.075318 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-d7ad8c36-f548-41af-9c5a-74693962bb75 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:06:41.076434 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-d7ad8c36-f548-41af-9c5a-74693962bb75 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] [instance: 309f67c8-0c6b-44ba-8084-7af7e889fb60] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:06:41.085904 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-d7ad8c36-f548-41af-9c5a-74693962bb75 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:06:41.086396 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-d7ad8c36-f548-41af-9c5a-74693962bb75 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:06:41.087507 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-d7ad8c36-f548-41af-9c5a-74693962bb75 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:06:41.088001 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-d7ad8c36-f548-41af-9c5a-74693962bb75 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:06:41.295444 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-5e5806e2-b2aa-43f6-a3be-96015303b4ab tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] 10.222.0.47 "DELETE /compute/v2.1/servers/dcb11872-0660-4e35-8d91-bfe80088844b/os-volume_attachments/d0ed7a52-97e1-4528-b7d5-eaa1128aed6b" status: 202 len: 0 microversion: 2.20 time: 0.603259 Feb 19 05:06:41.297032 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 450/903] 10.222.0.47 () {60 vars in 1447 bytes} [Fri Feb 19 05:06:40 2021] DELETE /compute/v2.1/servers/dcb11872-0660-4e35-8d91-bfe80088844b/os-volume_attachments/d0ed7a52-97e1-4528-b7d5-eaa1128aed6b => generated 0 bytes in 606 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Feb 19 05:06:41.427527 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-d7ad8c36-f548-41af-9c5a-74693962bb75 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32f894b7dad5447688fb395e08d31d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87857a2fc3a4866a8055ed181d12edf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:06:41.433262 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-841293ea-4205-4b1c-a113-2879ee8afe14 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:06:41.434157 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-841293ea-4205-4b1c-a113-2879ee8afe14 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] [instance: dcb11872-0660-4e35-8d91-bfe80088844b] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:06:41.438215 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-d7ad8c36-f548-41af-9c5a-74693962bb75 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] 10.222.0.47 "GET /compute/v2.1/servers/309f67c8-0c6b-44ba-8084-7af7e889fb60" status: 200 len: 1274 microversion: 2.1 time: 0.367333 Feb 19 05:06:41.439169 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 454/904] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:06:41 2021] GET /compute/v2.1/servers/309f67c8-0c6b-44ba-8084-7af7e889fb60 => generated 1274 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:06:41.443245 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-841293ea-4205-4b1c-a113-2879ee8afe14 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:06:41.443787 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-841293ea-4205-4b1c-a113-2879ee8afe14 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:06:41.444629 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-841293ea-4205-4b1c-a113-2879ee8afe14 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:06:41.445113 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-841293ea-4205-4b1c-a113-2879ee8afe14 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:06:41.603021 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-841293ea-4205-4b1c-a113-2879ee8afe14 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] 10.222.0.47 "POST /compute/v2.1/servers/dcb11872-0660-4e35-8d91-bfe80088844b/action" status: 202 len: 0 microversion: 2.20 time: 0.182201 Feb 19 05:06:41.603650 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 451/905] 10.222.0.47 () {62 vars in 1309 bytes} [Fri Feb 19 05:06:41 2021] POST /compute/v2.1/servers/dcb11872-0660-4e35-8d91-bfe80088844b/action => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Feb 19 05:06:41.613731 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-a7309e0c-e454-4def-b49a-d482dce49710 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:06:41.614571 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-a7309e0c-e454-4def-b49a-d482dce49710 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] [instance: dcb11872-0660-4e35-8d91-bfe80088844b] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:06:41.627770 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-a7309e0c-e454-4def-b49a-d482dce49710 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:06:41.628470 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-a7309e0c-e454-4def-b49a-d482dce49710 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:06:41.629396 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-a7309e0c-e454-4def-b49a-d482dce49710 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:06:41.630295 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-a7309e0c-e454-4def-b49a-d482dce49710 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:06:41.880885 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-a7309e0c-e454-4def-b49a-d482dce49710 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:06:41.893252 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-a7309e0c-e454-4def-b49a-d482dce49710 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:06:41.894998 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-a7309e0c-e454-4def-b49a-d482dce49710 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:06:41.896407 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-a7309e0c-e454-4def-b49a-d482dce49710 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] 10.222.0.47 "GET /compute/v2.1/servers/dcb11872-0660-4e35-8d91-bfe80088844b" status: 200 len: 1672 microversion: 2.20 time: 0.287361 Feb 19 05:06:41.897038 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 455/906] 10.222.0.47 () {60 vars in 1267 bytes} [Fri Feb 19 05:06:41 2021] GET /compute/v2.1/servers/dcb11872-0660-4e35-8d91-bfe80088844b => generated 1672 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 05:06:42.458593 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-b5f279e9-dade-4f66-93be-fb4912502433 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:06:42.459234 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-b5f279e9-dade-4f66-93be-fb4912502433 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] [instance: 309f67c8-0c6b-44ba-8084-7af7e889fb60] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:06:42.468623 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-b5f279e9-dade-4f66-93be-fb4912502433 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:06:42.469128 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-b5f279e9-dade-4f66-93be-fb4912502433 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:06:42.469969 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-b5f279e9-dade-4f66-93be-fb4912502433 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:06:42.470453 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-b5f279e9-dade-4f66-93be-fb4912502433 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:06:42.760045 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-b5f279e9-dade-4f66-93be-fb4912502433 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32f894b7dad5447688fb395e08d31d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87857a2fc3a4866a8055ed181d12edf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:06:42.770756 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-b5f279e9-dade-4f66-93be-fb4912502433 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] 10.222.0.47 "GET /compute/v2.1/servers/309f67c8-0c6b-44ba-8084-7af7e889fb60" status: 200 len: 1274 microversion: 2.1 time: 0.316874 Feb 19 05:06:42.771298 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 452/907] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:06:42 2021] GET /compute/v2.1/servers/309f67c8-0c6b-44ba-8084-7af7e889fb60 => generated 1274 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:06:42.917514 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-4924ddab-8cd8-44e7-a40b-493af76ab426 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:06:42.918178 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-4924ddab-8cd8-44e7-a40b-493af76ab426 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] [instance: dcb11872-0660-4e35-8d91-bfe80088844b] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:06:42.927192 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-4924ddab-8cd8-44e7-a40b-493af76ab426 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:06:42.927666 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-4924ddab-8cd8-44e7-a40b-493af76ab426 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:06:42.928533 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-4924ddab-8cd8-44e7-a40b-493af76ab426 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:06:42.929331 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-4924ddab-8cd8-44e7-a40b-493af76ab426 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:06:43.509332 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-4924ddab-8cd8-44e7-a40b-493af76ab426 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:06:43.527206 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-4924ddab-8cd8-44e7-a40b-493af76ab426 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:06:43.528829 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-4924ddab-8cd8-44e7-a40b-493af76ab426 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:06:43.530252 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-4924ddab-8cd8-44e7-a40b-493af76ab426 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] 10.222.0.47 "GET /compute/v2.1/servers/dcb11872-0660-4e35-8d91-bfe80088844b" status: 200 len: 1674 microversion: 2.20 time: 0.616974 Feb 19 05:06:43.530900 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 456/908] 10.222.0.47 () {60 vars in 1267 bytes} [Fri Feb 19 05:06:42 2021] GET /compute/v2.1/servers/dcb11872-0660-4e35-8d91-bfe80088844b => generated 1674 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 05:06:43.790337 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-38cb7a7a-9d27-4aaf-814e-a15c11ff157b tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:06:43.791016 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-38cb7a7a-9d27-4aaf-814e-a15c11ff157b tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] [instance: 309f67c8-0c6b-44ba-8084-7af7e889fb60] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:06:43.799902 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-38cb7a7a-9d27-4aaf-814e-a15c11ff157b tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:06:43.800420 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-38cb7a7a-9d27-4aaf-814e-a15c11ff157b tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:06:43.801283 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-38cb7a7a-9d27-4aaf-814e-a15c11ff157b tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:06:43.801776 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-38cb7a7a-9d27-4aaf-814e-a15c11ff157b tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:06:44.052830 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-38cb7a7a-9d27-4aaf-814e-a15c11ff157b tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32f894b7dad5447688fb395e08d31d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87857a2fc3a4866a8055ed181d12edf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:06:44.062665 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-38cb7a7a-9d27-4aaf-814e-a15c11ff157b tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] 10.222.0.47 "GET /compute/v2.1/servers/309f67c8-0c6b-44ba-8084-7af7e889fb60" status: 200 len: 1274 microversion: 2.1 time: 0.277106 Feb 19 05:06:44.063294 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 453/909] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:06:43 2021] GET /compute/v2.1/servers/309f67c8-0c6b-44ba-8084-7af7e889fb60 => generated 1274 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:06:44.551852 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-f485cb03-fbcc-43f9-8124-7a253c3f50f9 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:06:44.552536 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-f485cb03-fbcc-43f9-8124-7a253c3f50f9 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] [instance: dcb11872-0660-4e35-8d91-bfe80088844b] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:06:44.562638 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-f485cb03-fbcc-43f9-8124-7a253c3f50f9 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:06:44.563200 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-f485cb03-fbcc-43f9-8124-7a253c3f50f9 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:06:44.563463 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [req-05ad76b5-2b68-4699-83ea-d13f92c25330 req-845cf424-0c56-4319-820c-1eb128197e80 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "309f67c8-0c6b-44ba-8084-7af7e889fb60", "name": "network-vif-plugged", "status": "completed", "tag": "a7ea70c1-0ec6-4ca5-a043-58240dd4372b"}]} {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:06:44.564083 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-f485cb03-fbcc-43f9-8124-7a253c3f50f9 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:06:44.564664 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-f485cb03-fbcc-43f9-8124-7a253c3f50f9 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:06:44.565092 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 05:06:44.565092 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: warnings.warn(msg) Feb 19 05:06:44.575187 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [req-05ad76b5-2b68-4699-83ea-d13f92c25330 req-845cf424-0c56-4319-820c-1eb128197e80 service nova] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:06:44.575725 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [req-05ad76b5-2b68-4699-83ea-d13f92c25330 req-845cf424-0c56-4319-820c-1eb128197e80 service nova] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:06:44.594943 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.compute.server_external_events [req-05ad76b5-2b68-4699-83ea-d13f92c25330 req-845cf424-0c56-4319-820c-1eb128197e80 service nova] Creating event network-vif-plugged:a7ea70c1-0ec6-4ca5-a043-58240dd4372b for instance 309f67c8-0c6b-44ba-8084-7af7e889fb60 on hv-cinder-77642 Feb 19 05:06:44.600172 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [req-05ad76b5-2b68-4699-83ea-d13f92c25330 req-845cf424-0c56-4319-820c-1eb128197e80 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041723 Feb 19 05:06:44.600989 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 454/910] 10.222.0.47 () {64 vars in 1308 bytes} [Fri Feb 19 05:06:44 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 05:06:44.938607 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-f485cb03-fbcc-43f9-8124-7a253c3f50f9 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:06:44.964763 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-f485cb03-fbcc-43f9-8124-7a253c3f50f9 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:06:44.966918 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-f485cb03-fbcc-43f9-8124-7a253c3f50f9 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:06:44.968328 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-f485cb03-fbcc-43f9-8124-7a253c3f50f9 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] 10.222.0.47 "GET /compute/v2.1/servers/dcb11872-0660-4e35-8d91-bfe80088844b" status: 200 len: 1730 microversion: 2.20 time: 0.420789 Feb 19 05:06:44.968963 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 457/911] 10.222.0.47 () {60 vars in 1267 bytes} [Fri Feb 19 05:06:44 2021] GET /compute/v2.1/servers/dcb11872-0660-4e35-8d91-bfe80088844b => generated 1730 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 19 05:06:45.083975 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-8f4d94ba-9c12-4d69-80ae-89e4ec0446b0 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:06:45.085034 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-8f4d94ba-9c12-4d69-80ae-89e4ec0446b0 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] [instance: 309f67c8-0c6b-44ba-8084-7af7e889fb60] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:06:45.095190 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-8f4d94ba-9c12-4d69-80ae-89e4ec0446b0 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:06:45.095904 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-8f4d94ba-9c12-4d69-80ae-89e4ec0446b0 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:06:45.097018 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-8f4d94ba-9c12-4d69-80ae-89e4ec0446b0 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:06:45.097678 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-8f4d94ba-9c12-4d69-80ae-89e4ec0446b0 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:06:45.338462 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-8f4d94ba-9c12-4d69-80ae-89e4ec0446b0 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32f894b7dad5447688fb395e08d31d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87857a2fc3a4866a8055ed181d12edf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:06:45.349535 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-8f4d94ba-9c12-4d69-80ae-89e4ec0446b0 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] 10.222.0.47 "GET /compute/v2.1/servers/309f67c8-0c6b-44ba-8084-7af7e889fb60" status: 200 len: 1274 microversion: 2.1 time: 0.270645 Feb 19 05:06:45.350228 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 455/912] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:06:45 2021] GET /compute/v2.1/servers/309f67c8-0c6b-44ba-8084-7af7e889fb60 => generated 1274 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:06:45.992869 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-954f22d5-e824-4fba-ad44-681534681260 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:06:45.993652 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-954f22d5-e824-4fba-ad44-681534681260 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] [instance: dcb11872-0660-4e35-8d91-bfe80088844b] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:06:46.002816 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-954f22d5-e824-4fba-ad44-681534681260 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:06:46.003621 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-954f22d5-e824-4fba-ad44-681534681260 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:06:46.004772 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-954f22d5-e824-4fba-ad44-681534681260 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:06:46.005475 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-954f22d5-e824-4fba-ad44-681534681260 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:06:46.257035 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-954f22d5-e824-4fba-ad44-681534681260 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:06:46.267531 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-954f22d5-e824-4fba-ad44-681534681260 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:06:46.269112 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-954f22d5-e824-4fba-ad44-681534681260 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:06:46.270355 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-954f22d5-e824-4fba-ad44-681534681260 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] 10.222.0.47 "GET /compute/v2.1/servers/dcb11872-0660-4e35-8d91-bfe80088844b" status: 200 len: 1730 microversion: 2.20 time: 0.284618 Feb 19 05:06:46.271090 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 458/913] 10.222.0.47 () {60 vars in 1267 bytes} [Fri Feb 19 05:06:45 2021] GET /compute/v2.1/servers/dcb11872-0660-4e35-8d91-bfe80088844b => generated 1730 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 19 05:06:46.367886 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-16b71e9e-d705-47e8-8e64-3e6be4ba5ee4 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:06:46.368556 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-16b71e9e-d705-47e8-8e64-3e6be4ba5ee4 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] [instance: 309f67c8-0c6b-44ba-8084-7af7e889fb60] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:06:46.378187 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-16b71e9e-d705-47e8-8e64-3e6be4ba5ee4 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:06:46.378687 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-16b71e9e-d705-47e8-8e64-3e6be4ba5ee4 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:06:46.379573 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-16b71e9e-d705-47e8-8e64-3e6be4ba5ee4 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:06:46.380063 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-16b71e9e-d705-47e8-8e64-3e6be4ba5ee4 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:06:46.608990 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-16b71e9e-d705-47e8-8e64-3e6be4ba5ee4 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32f894b7dad5447688fb395e08d31d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87857a2fc3a4866a8055ed181d12edf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:06:46.623494 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-16b71e9e-d705-47e8-8e64-3e6be4ba5ee4 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] 10.222.0.47 "GET /compute/v2.1/servers/309f67c8-0c6b-44ba-8084-7af7e889fb60" status: 200 len: 1274 microversion: 2.1 time: 0.258368 Feb 19 05:06:46.624215 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 456/914] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:06:46 2021] GET /compute/v2.1/servers/309f67c8-0c6b-44ba-8084-7af7e889fb60 => generated 1274 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 05:06:47.292750 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-ff4e40af-af92-43ae-bedb-7679562f80bc tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:06:47.293297 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-ff4e40af-af92-43ae-bedb-7679562f80bc tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] [instance: dcb11872-0660-4e35-8d91-bfe80088844b] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:06:47.302637 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-ff4e40af-af92-43ae-bedb-7679562f80bc tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:06:47.303154 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-ff4e40af-af92-43ae-bedb-7679562f80bc tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:06:47.304043 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-ff4e40af-af92-43ae-bedb-7679562f80bc tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:06:47.304532 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-ff4e40af-af92-43ae-bedb-7679562f80bc tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:06:47.533739 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-ff4e40af-af92-43ae-bedb-7679562f80bc tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:06:47.544433 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-ff4e40af-af92-43ae-bedb-7679562f80bc tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:06:47.546104 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-ff4e40af-af92-43ae-bedb-7679562f80bc tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:06:47.547362 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-ff4e40af-af92-43ae-bedb-7679562f80bc tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] 10.222.0.47 "GET /compute/v2.1/servers/dcb11872-0660-4e35-8d91-bfe80088844b" status: 200 len: 1730 microversion: 2.20 time: 0.258892 Feb 19 05:06:47.548097 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 459/915] 10.222.0.47 () {60 vars in 1267 bytes} [Fri Feb 19 05:06:47 2021] GET /compute/v2.1/servers/dcb11872-0660-4e35-8d91-bfe80088844b => generated 1730 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 05:06:47.642776 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-823c907f-c6b5-4d89-8985-5bdb0c72f9fb tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:06:47.643493 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-823c907f-c6b5-4d89-8985-5bdb0c72f9fb tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] [instance: 309f67c8-0c6b-44ba-8084-7af7e889fb60] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:06:47.651883 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-823c907f-c6b5-4d89-8985-5bdb0c72f9fb tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:06:47.652396 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-823c907f-c6b5-4d89-8985-5bdb0c72f9fb tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:06:47.653370 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-823c907f-c6b5-4d89-8985-5bdb0c72f9fb tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:06:47.654156 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-823c907f-c6b5-4d89-8985-5bdb0c72f9fb tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:06:47.895114 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-823c907f-c6b5-4d89-8985-5bdb0c72f9fb tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32f894b7dad5447688fb395e08d31d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87857a2fc3a4866a8055ed181d12edf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:06:47.905475 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-823c907f-c6b5-4d89-8985-5bdb0c72f9fb tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] 10.222.0.47 "GET /compute/v2.1/servers/309f67c8-0c6b-44ba-8084-7af7e889fb60" status: 200 len: 1274 microversion: 2.1 time: 0.266731 Feb 19 05:06:47.906447 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 457/916] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:06:47 2021] GET /compute/v2.1/servers/309f67c8-0c6b-44ba-8084-7af7e889fb60 => generated 1274 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:06:48.567365 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-336b32d4-498b-4198-ac85-cd5ad26196c5 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:06:48.568171 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-336b32d4-498b-4198-ac85-cd5ad26196c5 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] [instance: dcb11872-0660-4e35-8d91-bfe80088844b] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:06:48.577293 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-336b32d4-498b-4198-ac85-cd5ad26196c5 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:06:48.577813 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-336b32d4-498b-4198-ac85-cd5ad26196c5 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:06:48.578839 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-336b32d4-498b-4198-ac85-cd5ad26196c5 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:06:48.579359 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-336b32d4-498b-4198-ac85-cd5ad26196c5 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:06:48.812132 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-336b32d4-498b-4198-ac85-cd5ad26196c5 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:06:48.822772 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-336b32d4-498b-4198-ac85-cd5ad26196c5 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:06:48.824410 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-336b32d4-498b-4198-ac85-cd5ad26196c5 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:06:48.826169 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-336b32d4-498b-4198-ac85-cd5ad26196c5 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] 10.222.0.47 "GET /compute/v2.1/servers/dcb11872-0660-4e35-8d91-bfe80088844b" status: 200 len: 1730 microversion: 2.20 time: 0.262660 Feb 19 05:06:48.826818 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 460/917] 10.222.0.47 () {60 vars in 1267 bytes} [Fri Feb 19 05:06:48 2021] GET /compute/v2.1/servers/dcb11872-0660-4e35-8d91-bfe80088844b => generated 1730 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 05:06:48.931386 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-fe923fc1-f7c0-42dd-abd1-451ed7d5979b tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:06:48.933403 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-fe923fc1-f7c0-42dd-abd1-451ed7d5979b tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] [instance: 309f67c8-0c6b-44ba-8084-7af7e889fb60] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:06:48.951723 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-fe923fc1-f7c0-42dd-abd1-451ed7d5979b tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:06:48.952204 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-fe923fc1-f7c0-42dd-abd1-451ed7d5979b tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:06:48.954438 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-fe923fc1-f7c0-42dd-abd1-451ed7d5979b tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:06:48.954931 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-fe923fc1-f7c0-42dd-abd1-451ed7d5979b tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:06:49.197101 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-fe923fc1-f7c0-42dd-abd1-451ed7d5979b tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32f894b7dad5447688fb395e08d31d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87857a2fc3a4866a8055ed181d12edf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:06:49.213283 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-fe923fc1-f7c0-42dd-abd1-451ed7d5979b tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] 10.222.0.47 "GET /compute/v2.1/servers/309f67c8-0c6b-44ba-8084-7af7e889fb60" status: 200 len: 1274 microversion: 2.1 time: 0.290925 Feb 19 05:06:49.214075 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 458/918] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:06:48 2021] GET /compute/v2.1/servers/309f67c8-0c6b-44ba-8084-7af7e889fb60 => generated 1274 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:06:49.849029 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-fca195c4-27ae-463f-a781-16d89e172f50 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:06:49.849697 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-fca195c4-27ae-463f-a781-16d89e172f50 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] [instance: dcb11872-0660-4e35-8d91-bfe80088844b] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:06:49.858401 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-fca195c4-27ae-463f-a781-16d89e172f50 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:06:49.858988 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-fca195c4-27ae-463f-a781-16d89e172f50 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:06:49.859836 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-fca195c4-27ae-463f-a781-16d89e172f50 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:06:49.860332 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-fca195c4-27ae-463f-a781-16d89e172f50 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:06:50.129884 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-fca195c4-27ae-463f-a781-16d89e172f50 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:06:50.142355 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-fca195c4-27ae-463f-a781-16d89e172f50 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:06:50.144314 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-fca195c4-27ae-463f-a781-16d89e172f50 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:06:50.145587 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-fca195c4-27ae-463f-a781-16d89e172f50 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] 10.222.0.47 "GET /compute/v2.1/servers/dcb11872-0660-4e35-8d91-bfe80088844b" status: 200 len: 1730 microversion: 2.20 time: 0.302261 Feb 19 05:06:50.158210 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 461/919] 10.222.0.47 () {60 vars in 1267 bytes} [Fri Feb 19 05:06:49 2021] GET /compute/v2.1/servers/dcb11872-0660-4e35-8d91-bfe80088844b => generated 1730 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 05:06:50.232215 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-44e1aada-8443-4da5-a91f-c825250cf2c9 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:06:50.233072 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-44e1aada-8443-4da5-a91f-c825250cf2c9 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] [instance: 309f67c8-0c6b-44ba-8084-7af7e889fb60] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:06:50.241649 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-44e1aada-8443-4da5-a91f-c825250cf2c9 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:06:50.242225 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-44e1aada-8443-4da5-a91f-c825250cf2c9 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:06:50.243021 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-44e1aada-8443-4da5-a91f-c825250cf2c9 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:06:50.243560 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-44e1aada-8443-4da5-a91f-c825250cf2c9 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:06:50.494356 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-44e1aada-8443-4da5-a91f-c825250cf2c9 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32f894b7dad5447688fb395e08d31d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87857a2fc3a4866a8055ed181d12edf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:06:50.503978 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-44e1aada-8443-4da5-a91f-c825250cf2c9 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] 10.222.0.47 "GET /compute/v2.1/servers/309f67c8-0c6b-44ba-8084-7af7e889fb60" status: 200 len: 1274 microversion: 2.1 time: 0.276058 Feb 19 05:06:50.504850 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 459/920] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:06:50 2021] GET /compute/v2.1/servers/309f67c8-0c6b-44ba-8084-7af7e889fb60 => generated 1274 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:06:51.166342 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-93506d4b-508c-4095-8adb-30a63960c847 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:06:51.167391 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-93506d4b-508c-4095-8adb-30a63960c847 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] [instance: dcb11872-0660-4e35-8d91-bfe80088844b] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:06:51.176954 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-93506d4b-508c-4095-8adb-30a63960c847 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:06:51.177737 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-93506d4b-508c-4095-8adb-30a63960c847 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:06:51.179016 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-93506d4b-508c-4095-8adb-30a63960c847 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:06:51.179095 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-93506d4b-508c-4095-8adb-30a63960c847 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:06:51.423749 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-93506d4b-508c-4095-8adb-30a63960c847 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:06:51.435828 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-93506d4b-508c-4095-8adb-30a63960c847 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:06:51.437688 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-93506d4b-508c-4095-8adb-30a63960c847 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:06:51.439011 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-93506d4b-508c-4095-8adb-30a63960c847 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] 10.222.0.47 "GET /compute/v2.1/servers/dcb11872-0660-4e35-8d91-bfe80088844b" status: 200 len: 1730 microversion: 2.20 time: 0.276756 Feb 19 05:06:51.439620 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 462/921] 10.222.0.47 () {60 vars in 1267 bytes} [Fri Feb 19 05:06:51 2021] GET /compute/v2.1/servers/dcb11872-0660-4e35-8d91-bfe80088844b => generated 1730 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 05:06:51.522671 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-93b7b3aa-670b-492b-83bd-da903d4b1b7c tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:06:51.523428 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-93b7b3aa-670b-492b-83bd-da903d4b1b7c tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] [instance: 309f67c8-0c6b-44ba-8084-7af7e889fb60] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:06:51.532518 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-93b7b3aa-670b-492b-83bd-da903d4b1b7c tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:06:51.533035 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-93b7b3aa-670b-492b-83bd-da903d4b1b7c tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:06:51.533895 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-93b7b3aa-670b-492b-83bd-da903d4b1b7c tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:06:51.534419 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-93b7b3aa-670b-492b-83bd-da903d4b1b7c tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:06:51.777893 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-93b7b3aa-670b-492b-83bd-da903d4b1b7c tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32f894b7dad5447688fb395e08d31d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87857a2fc3a4866a8055ed181d12edf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:06:51.787501 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-93b7b3aa-670b-492b-83bd-da903d4b1b7c tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] 10.222.0.47 "GET /compute/v2.1/servers/309f67c8-0c6b-44ba-8084-7af7e889fb60" status: 200 len: 1274 microversion: 2.1 time: 0.268764 Feb 19 05:06:51.788367 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 460/922] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:06:51 2021] GET /compute/v2.1/servers/309f67c8-0c6b-44ba-8084-7af7e889fb60 => generated 1274 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:06:52.459669 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-e1983eee-976b-4b13-ac06-1a4c45f1a0fd tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:06:52.460383 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-e1983eee-976b-4b13-ac06-1a4c45f1a0fd tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] [instance: dcb11872-0660-4e35-8d91-bfe80088844b] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:06:52.469229 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-e1983eee-976b-4b13-ac06-1a4c45f1a0fd tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:06:52.469740 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-e1983eee-976b-4b13-ac06-1a4c45f1a0fd tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:06:52.470590 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-e1983eee-976b-4b13-ac06-1a4c45f1a0fd tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:06:52.471081 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-e1983eee-976b-4b13-ac06-1a4c45f1a0fd tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:06:52.714007 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-e1983eee-976b-4b13-ac06-1a4c45f1a0fd tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:06:52.725617 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-e1983eee-976b-4b13-ac06-1a4c45f1a0fd tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:06:52.727204 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-e1983eee-976b-4b13-ac06-1a4c45f1a0fd tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:06:52.728499 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-e1983eee-976b-4b13-ac06-1a4c45f1a0fd tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] 10.222.0.47 "GET /compute/v2.1/servers/dcb11872-0660-4e35-8d91-bfe80088844b" status: 200 len: 1730 microversion: 2.20 time: 0.273184 Feb 19 05:06:52.729123 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 463/923] 10.222.0.47 () {60 vars in 1267 bytes} [Fri Feb 19 05:06:52 2021] GET /compute/v2.1/servers/dcb11872-0660-4e35-8d91-bfe80088844b => generated 1730 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 05:06:52.806400 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-d91372f7-efd4-4ca5-860d-07008613ac31 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:06:52.807278 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-d91372f7-efd4-4ca5-860d-07008613ac31 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] [instance: 309f67c8-0c6b-44ba-8084-7af7e889fb60] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:06:52.816223 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-d91372f7-efd4-4ca5-860d-07008613ac31 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:06:52.816725 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-d91372f7-efd4-4ca5-860d-07008613ac31 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:06:52.817660 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-d91372f7-efd4-4ca5-860d-07008613ac31 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:06:52.818145 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-d91372f7-efd4-4ca5-860d-07008613ac31 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:06:53.087278 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-d91372f7-efd4-4ca5-860d-07008613ac31 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32f894b7dad5447688fb395e08d31d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87857a2fc3a4866a8055ed181d12edf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:06:53.097865 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-d91372f7-efd4-4ca5-860d-07008613ac31 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] 10.222.0.47 "GET /compute/v2.1/servers/309f67c8-0c6b-44ba-8084-7af7e889fb60" status: 200 len: 1274 microversion: 2.1 time: 0.295618 Feb 19 05:06:53.098507 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 461/924] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:06:52 2021] GET /compute/v2.1/servers/309f67c8-0c6b-44ba-8084-7af7e889fb60 => generated 1274 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:06:53.749577 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-90335303-90e2-47e0-9584-f505e5b1f17b tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:06:53.750172 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-90335303-90e2-47e0-9584-f505e5b1f17b tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] [instance: dcb11872-0660-4e35-8d91-bfe80088844b] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:06:53.758276 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-90335303-90e2-47e0-9584-f505e5b1f17b tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:06:53.758772 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-90335303-90e2-47e0-9584-f505e5b1f17b tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:06:53.759665 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-90335303-90e2-47e0-9584-f505e5b1f17b tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:06:53.760154 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-90335303-90e2-47e0-9584-f505e5b1f17b tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:06:54.026632 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-90335303-90e2-47e0-9584-f505e5b1f17b tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:06:54.038734 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-90335303-90e2-47e0-9584-f505e5b1f17b tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:06:54.040347 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-90335303-90e2-47e0-9584-f505e5b1f17b tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:06:54.041558 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-90335303-90e2-47e0-9584-f505e5b1f17b tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] 10.222.0.47 "GET /compute/v2.1/servers/dcb11872-0660-4e35-8d91-bfe80088844b" status: 200 len: 1730 microversion: 2.20 time: 0.296534 Feb 19 05:06:54.042516 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 464/925] 10.222.0.47 () {60 vars in 1267 bytes} [Fri Feb 19 05:06:53 2021] GET /compute/v2.1/servers/dcb11872-0660-4e35-8d91-bfe80088844b => generated 1730 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 05:06:54.116196 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-4651a15b-c68b-4594-a533-d9ac3f1faf90 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:06:54.116875 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-4651a15b-c68b-4594-a533-d9ac3f1faf90 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] [instance: 309f67c8-0c6b-44ba-8084-7af7e889fb60] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:06:54.126835 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-4651a15b-c68b-4594-a533-d9ac3f1faf90 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:06:54.127391 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-4651a15b-c68b-4594-a533-d9ac3f1faf90 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:06:54.128571 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-4651a15b-c68b-4594-a533-d9ac3f1faf90 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:06:54.129093 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-4651a15b-c68b-4594-a533-d9ac3f1faf90 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:06:54.409037 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-4651a15b-c68b-4594-a533-d9ac3f1faf90 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32f894b7dad5447688fb395e08d31d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87857a2fc3a4866a8055ed181d12edf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:06:54.419582 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-4651a15b-c68b-4594-a533-d9ac3f1faf90 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] 10.222.0.47 "GET /compute/v2.1/servers/309f67c8-0c6b-44ba-8084-7af7e889fb60" status: 200 len: 1274 microversion: 2.1 time: 0.306800 Feb 19 05:06:54.420252 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 462/926] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:06:54 2021] GET /compute/v2.1/servers/309f67c8-0c6b-44ba-8084-7af7e889fb60 => generated 1274 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:06:55.063867 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-3c6b167b-0513-49b9-9569-fde91807cd41 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:06:55.064647 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-3c6b167b-0513-49b9-9569-fde91807cd41 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] [instance: dcb11872-0660-4e35-8d91-bfe80088844b] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:06:55.073142 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-3c6b167b-0513-49b9-9569-fde91807cd41 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:06:55.073654 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-3c6b167b-0513-49b9-9569-fde91807cd41 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:06:55.074507 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-3c6b167b-0513-49b9-9569-fde91807cd41 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:06:55.075057 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-3c6b167b-0513-49b9-9569-fde91807cd41 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:06:55.305425 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-3c6b167b-0513-49b9-9569-fde91807cd41 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:06:55.316141 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-3c6b167b-0513-49b9-9569-fde91807cd41 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:06:55.317713 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-3c6b167b-0513-49b9-9569-fde91807cd41 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:06:55.318940 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-3c6b167b-0513-49b9-9569-fde91807cd41 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] 10.222.0.47 "GET /compute/v2.1/servers/dcb11872-0660-4e35-8d91-bfe80088844b" status: 200 len: 1730 microversion: 2.20 time: 0.260535 Feb 19 05:06:55.319601 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 465/927] 10.222.0.47 () {60 vars in 1267 bytes} [Fri Feb 19 05:06:55 2021] GET /compute/v2.1/servers/dcb11872-0660-4e35-8d91-bfe80088844b => generated 1730 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 05:06:55.437950 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-2795534d-a65b-472c-897c-ce730b2c23c5 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:06:55.438793 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-2795534d-a65b-472c-897c-ce730b2c23c5 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] [instance: 309f67c8-0c6b-44ba-8084-7af7e889fb60] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:06:55.447513 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-2795534d-a65b-472c-897c-ce730b2c23c5 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:06:55.448030 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-2795534d-a65b-472c-897c-ce730b2c23c5 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:06:55.448902 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-2795534d-a65b-472c-897c-ce730b2c23c5 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:06:55.449398 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-2795534d-a65b-472c-897c-ce730b2c23c5 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:06:55.680127 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-2795534d-a65b-472c-897c-ce730b2c23c5 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32f894b7dad5447688fb395e08d31d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87857a2fc3a4866a8055ed181d12edf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:06:55.689745 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-2795534d-a65b-472c-897c-ce730b2c23c5 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] 10.222.0.47 "GET /compute/v2.1/servers/309f67c8-0c6b-44ba-8084-7af7e889fb60" status: 200 len: 1274 microversion: 2.1 time: 0.256002 Feb 19 05:06:55.690722 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 463/928] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:06:55 2021] GET /compute/v2.1/servers/309f67c8-0c6b-44ba-8084-7af7e889fb60 => generated 1274 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:06:56.340979 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-c6c7d082-43cd-49ee-97a9-2fa796e6f00f tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:06:56.341644 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-c6c7d082-43cd-49ee-97a9-2fa796e6f00f tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] [instance: dcb11872-0660-4e35-8d91-bfe80088844b] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:06:56.349605 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-c6c7d082-43cd-49ee-97a9-2fa796e6f00f tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:06:56.350111 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-c6c7d082-43cd-49ee-97a9-2fa796e6f00f tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:06:56.351113 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-c6c7d082-43cd-49ee-97a9-2fa796e6f00f tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:06:56.351469 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-c6c7d082-43cd-49ee-97a9-2fa796e6f00f tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:06:56.582023 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-c6c7d082-43cd-49ee-97a9-2fa796e6f00f tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:06:56.593986 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-c6c7d082-43cd-49ee-97a9-2fa796e6f00f tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:06:56.596429 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-c6c7d082-43cd-49ee-97a9-2fa796e6f00f tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:06:56.597824 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-c6c7d082-43cd-49ee-97a9-2fa796e6f00f tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] 10.222.0.47 "GET /compute/v2.1/servers/dcb11872-0660-4e35-8d91-bfe80088844b" status: 200 len: 1730 microversion: 2.20 time: 0.260972 Feb 19 05:06:56.599364 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 466/929] 10.222.0.47 () {60 vars in 1267 bytes} [Fri Feb 19 05:06:56 2021] GET /compute/v2.1/servers/dcb11872-0660-4e35-8d91-bfe80088844b => generated 1730 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 05:06:56.708332 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-b52ce646-f981-440e-9259-053615d57f0f tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:06:56.709008 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-b52ce646-f981-440e-9259-053615d57f0f tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] [instance: 309f67c8-0c6b-44ba-8084-7af7e889fb60] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:06:56.717439 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-b52ce646-f981-440e-9259-053615d57f0f tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:06:56.717888 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-b52ce646-f981-440e-9259-053615d57f0f tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:06:56.718757 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-b52ce646-f981-440e-9259-053615d57f0f tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:06:56.719251 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-b52ce646-f981-440e-9259-053615d57f0f tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:06:56.911224 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-241a6db1-52b3-4e3c-b729-900479499b70 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:06:56.912428 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-241a6db1-52b3-4e3c-b729-900479499b70 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] [instance: f5e90100-1612-4e18-b86c-db90e3045760] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:06:56.921424 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-241a6db1-52b3-4e3c-b729-900479499b70 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:06:56.921952 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-241a6db1-52b3-4e3c-b729-900479499b70 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:06:56.922801 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-241a6db1-52b3-4e3c-b729-900479499b70 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:06:56.923303 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-241a6db1-52b3-4e3c-b729-900479499b70 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:06:56.969905 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-b52ce646-f981-440e-9259-053615d57f0f tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32f894b7dad5447688fb395e08d31d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87857a2fc3a4866a8055ed181d12edf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:06:56.979704 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-b52ce646-f981-440e-9259-053615d57f0f tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] 10.222.0.47 "GET /compute/v2.1/servers/309f67c8-0c6b-44ba-8084-7af7e889fb60" status: 200 len: 1460 microversion: 2.1 time: 0.275618 Feb 19 05:06:56.980678 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 464/930] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:06:56 2021] GET /compute/v2.1/servers/309f67c8-0c6b-44ba-8084-7af7e889fb60 => generated 1460 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:06:56.999281 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-d089d08c-315d-4ece-98b0-8f751695f1c5 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:06:57.000153 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-d089d08c-315d-4ece-98b0-8f751695f1c5 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] [instance: 309f67c8-0c6b-44ba-8084-7af7e889fb60] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:06:57.008486 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-d089d08c-315d-4ece-98b0-8f751695f1c5 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:06:57.009334 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-d089d08c-315d-4ece-98b0-8f751695f1c5 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:06:57.009937 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-d089d08c-315d-4ece-98b0-8f751695f1c5 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:06:57.010424 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-d089d08c-315d-4ece-98b0-8f751695f1c5 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:06:57.014659 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-241a6db1-52b3-4e3c-b729-900479499b70 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] 10.222.0.47 "GET /compute/v2.1/servers/f5e90100-1612-4e18-b86c-db90e3045760/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.107658 Feb 19 05:06:57.015297 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 467/931] 10.222.0.47 () {58 vars in 1292 bytes} [Fri Feb 19 05:06:56 2021] GET /compute/v2.1/servers/f5e90100-1612-4e18-b86c-db90e3045760/os-volume_attachments => generated 197 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 19 05:06:57.026013 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-547d89a0-acf7-49a1-826c-031c373ad48f tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:06:57.026558 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-547d89a0-acf7-49a1-826c-031c373ad48f tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] [instance: f5e90100-1612-4e18-b86c-db90e3045760] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:06:57.035506 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-547d89a0-acf7-49a1-826c-031c373ad48f tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:06:57.036020 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-547d89a0-acf7-49a1-826c-031c373ad48f tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:06:57.036877 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-547d89a0-acf7-49a1-826c-031c373ad48f tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:06:57.037377 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-547d89a0-acf7-49a1-826c-031c373ad48f tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:06:57.111478 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-547d89a0-acf7-49a1-826c-031c373ad48f tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] 10.222.0.47 "GET /compute/v2.1/servers/f5e90100-1612-4e18-b86c-db90e3045760/os-volume_attachments/17b5dc6e-bd46-48bc-969e-b08d0f1f003d" status: 200 len: 194 microversion: 2.1 time: 0.089215 Feb 19 05:06:57.112016 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 468/932] 10.222.0.47 () {58 vars in 1403 bytes} [Fri Feb 19 05:06:57 2021] GET /compute/v2.1/servers/f5e90100-1612-4e18-b86c-db90e3045760/os-volume_attachments/17b5dc6e-bd46-48bc-969e-b08d0f1f003d => generated 194 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 19 05:06:57.233300 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-d089d08c-315d-4ece-98b0-8f751695f1c5 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32f894b7dad5447688fb395e08d31d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87857a2fc3a4866a8055ed181d12edf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:06:57.244366 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-d089d08c-315d-4ece-98b0-8f751695f1c5 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] 10.222.0.47 "GET /compute/v2.1/servers/309f67c8-0c6b-44ba-8084-7af7e889fb60" status: 200 len: 1460 microversion: 2.1 time: 0.249245 Feb 19 05:06:57.245192 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 465/933] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:06:56 2021] GET /compute/v2.1/servers/309f67c8-0c6b-44ba-8084-7af7e889fb60 => generated 1460 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:06:57.268696 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-9102fe01-2da8-4e3c-b295-894640b868f7 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Action: 'create', calling method: .version_select at 0x7f270723b268>, body: {"pool": null} {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:06:57.622960 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-6f15c762-2af1-4bcf-8830-50c7a463d89a tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:06:57.624223 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-6f15c762-2af1-4bcf-8830-50c7a463d89a tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] [instance: dcb11872-0660-4e35-8d91-bfe80088844b] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:06:57.634237 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-6f15c762-2af1-4bcf-8830-50c7a463d89a tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:06:57.634746 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-6f15c762-2af1-4bcf-8830-50c7a463d89a tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:06:57.635622 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-6f15c762-2af1-4bcf-8830-50c7a463d89a tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:06:57.636112 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-6f15c762-2af1-4bcf-8830-50c7a463d89a tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:06:58.051068 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-6f15c762-2af1-4bcf-8830-50c7a463d89a tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:06:58.061052 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-6f15c762-2af1-4bcf-8830-50c7a463d89a tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:06:58.062607 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-6f15c762-2af1-4bcf-8830-50c7a463d89a tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:06:58.063897 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-6f15c762-2af1-4bcf-8830-50c7a463d89a tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] 10.222.0.47 "GET /compute/v2.1/servers/dcb11872-0660-4e35-8d91-bfe80088844b" status: 200 len: 1730 microversion: 2.20 time: 0.449211 Feb 19 05:06:58.064529 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 466/934] 10.222.0.47 () {60 vars in 1267 bytes} [Fri Feb 19 05:06:57 2021] GET /compute/v2.1/servers/dcb11872-0660-4e35-8d91-bfe80088844b => generated 1730 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 05:06:58.688891 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [req-504578aa-8faa-4935-b97a-e56dbed0ac47 req-9ca0b093-41ec-49a6-9313-033936616e0c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dcb11872-0660-4e35-8d91-bfe80088844b", "name": "network-vif-plugged", "status": "completed", "tag": "02a5dd6b-46b0-46bc-b05b-eb9f66823a35"}]} {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:06:58.691070 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 05:06:58.691070 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: warnings.warn(msg) Feb 19 05:06:58.702478 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [req-504578aa-8faa-4935-b97a-e56dbed0ac47 req-9ca0b093-41ec-49a6-9313-033936616e0c service nova] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:06:58.703113 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [req-504578aa-8faa-4935-b97a-e56dbed0ac47 req-9ca0b093-41ec-49a6-9313-033936616e0c service nova] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:06:58.725477 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.compute.server_external_events [req-504578aa-8faa-4935-b97a-e56dbed0ac47 req-9ca0b093-41ec-49a6-9313-033936616e0c service nova] Creating event network-vif-plugged:02a5dd6b-46b0-46bc-b05b-eb9f66823a35 for instance dcb11872-0660-4e35-8d91-bfe80088844b on hv-cinder-77642 Feb 19 05:06:58.732381 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [req-504578aa-8faa-4935-b97a-e56dbed0ac47 req-9ca0b093-41ec-49a6-9313-033936616e0c service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048998 Feb 19 05:06:58.733722 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 467/935] 10.222.0.47 () {64 vars in 1308 bytes} [Fri Feb 19 05:06:58 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 05:06:58.802061 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-bf240668-9af0-4ae3-937e-13ccb1c1bf9c tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "92049282-2f9f-4cdb-b07b-c8918a072292"}} {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:06:58.804027 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-bf240668-9af0-4ae3-937e-13ccb1c1bf9c tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] [instance: f5e90100-1612-4e18-b86c-db90e3045760] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:06:58.813161 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-bf240668-9af0-4ae3-937e-13ccb1c1bf9c tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:06:58.813671 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-bf240668-9af0-4ae3-937e-13ccb1c1bf9c tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:06:58.814562 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-bf240668-9af0-4ae3-937e-13ccb1c1bf9c tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:06:58.815059 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-bf240668-9af0-4ae3-937e-13ccb1c1bf9c tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:06:59.453072 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-bf240668-9af0-4ae3-937e-13ccb1c1bf9c tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] 10.222.0.47 "POST /compute/v2.1/servers/f5e90100-1612-4e18-b86c-db90e3045760/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.655611 Feb 19 05:06:59.453688 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 468/936] 10.222.0.47 () {60 vars in 1313 bytes} [Fri Feb 19 05:06:58 2021] POST /compute/v2.1/servers/f5e90100-1612-4e18-b86c-db90e3045760/os-volume_attachments => generated 194 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 05:06:59.464561 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-ed739708-a440-4a0e-bcab-374d7e488c8c tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:06:59.465413 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-ed739708-a440-4a0e-bcab-374d7e488c8c tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] [instance: dcb11872-0660-4e35-8d91-bfe80088844b] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:06:59.474453 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-ed739708-a440-4a0e-bcab-374d7e488c8c tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:06:59.474959 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-ed739708-a440-4a0e-bcab-374d7e488c8c tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:06:59.475854 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-ed739708-a440-4a0e-bcab-374d7e488c8c tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:06:59.476344 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-ed739708-a440-4a0e-bcab-374d7e488c8c tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:06:59.948950 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-ed739708-a440-4a0e-bcab-374d7e488c8c tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:06:59.959544 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-ed739708-a440-4a0e-bcab-374d7e488c8c tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:06:59.961607 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-ed739708-a440-4a0e-bcab-374d7e488c8c tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:06:59.963016 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-ed739708-a440-4a0e-bcab-374d7e488c8c tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] 10.222.0.47 "GET /compute/v2.1/servers/dcb11872-0660-4e35-8d91-bfe80088844b" status: 200 len: 1730 microversion: 2.20 time: 0.503040 Feb 19 05:06:59.964165 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 469/937] 10.222.0.47 () {60 vars in 1267 bytes} [Fri Feb 19 05:06:59 2021] GET /compute/v2.1/servers/dcb11872-0660-4e35-8d91-bfe80088844b => generated 1730 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 05:07:00.255287 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-9102fe01-2da8-4e3c-b295-894640b868f7 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] 10.222.0.47 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.995939 Feb 19 05:07:00.255977 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 469/938] 10.222.0.47 () {60 vars in 1160 bytes} [Fri Feb 19 05:06:57 2021] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2998 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 05:07:00.270193 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-5d427ec9-8e17-4fb4-8af7-36bce434841e tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Action: 'action', calling method: .version_select at 0x7f27087f4378>, body: {"addFloatingIp": {"address": "172.27.0.216"}} {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:07:00.271507 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-5d427ec9-8e17-4fb4-8af7-36bce434841e tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] [instance: 309f67c8-0c6b-44ba-8084-7af7e889fb60] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:07:00.280385 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-5d427ec9-8e17-4fb4-8af7-36bce434841e tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:07:00.280894 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-5d427ec9-8e17-4fb4-8af7-36bce434841e tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:07:00.281729 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-5d427ec9-8e17-4fb4-8af7-36bce434841e tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:07:00.282212 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-5d427ec9-8e17-4fb4-8af7-36bce434841e tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:07:00.497574 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-5d427ec9-8e17-4fb4-8af7-36bce434841e tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Acquired lock "refresh_cache-309f67c8-0c6b-44ba-8084-7af7e889fb60" {{(pid=98153) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:266}} Feb 19 05:07:00.985959 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-6d64cd34-3e74-41d5-b5df-cdb99693dbb8 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:07:00.987529 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-6d64cd34-3e74-41d5-b5df-cdb99693dbb8 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] [instance: dcb11872-0660-4e35-8d91-bfe80088844b] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:07:00.996366 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-6d64cd34-3e74-41d5-b5df-cdb99693dbb8 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:07:00.998309 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-6d64cd34-3e74-41d5-b5df-cdb99693dbb8 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:07:00.999529 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-6d64cd34-3e74-41d5-b5df-cdb99693dbb8 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:07:01.000008 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-6d64cd34-3e74-41d5-b5df-cdb99693dbb8 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:07:01.774652 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-6d64cd34-3e74-41d5-b5df-cdb99693dbb8 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:07:01.784798 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-6d64cd34-3e74-41d5-b5df-cdb99693dbb8 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:07:01.786693 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-6d64cd34-3e74-41d5-b5df-cdb99693dbb8 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:07:01.788083 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-6d64cd34-3e74-41d5-b5df-cdb99693dbb8 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] 10.222.0.47 "GET /compute/v2.1/servers/dcb11872-0660-4e35-8d91-bfe80088844b" status: 200 len: 1730 microversion: 2.20 time: 0.807886 Feb 19 05:07:01.788905 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 470/939] 10.222.0.47 () {60 vars in 1267 bytes} [Fri Feb 19 05:07:00 2021] GET /compute/v2.1/servers/dcb11872-0660-4e35-8d91-bfe80088844b => generated 1730 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 19 05:07:02.810319 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-b1bdca16-39a2-4c6c-bbf4-34171d355323 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:07:02.811906 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-b1bdca16-39a2-4c6c-bbf4-34171d355323 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] [instance: dcb11872-0660-4e35-8d91-bfe80088844b] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:07:02.820174 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-b1bdca16-39a2-4c6c-bbf4-34171d355323 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:07:02.820787 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-b1bdca16-39a2-4c6c-bbf4-34171d355323 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:07:02.823389 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-b1bdca16-39a2-4c6c-bbf4-34171d355323 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:07:02.824060 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-b1bdca16-39a2-4c6c-bbf4-34171d355323 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:07:02.843464 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.network.neutron [None req-5d427ec9-8e17-4fb4-8af7-36bce434841e tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] [instance: 309f67c8-0c6b-44ba-8084-7af7e889fb60] Building network info cache for instance {{(pid=98153) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1836}} Feb 19 05:07:03.256784 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-b1bdca16-39a2-4c6c-bbf4-34171d355323 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:07:03.269231 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-b1bdca16-39a2-4c6c-bbf4-34171d355323 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:07:03.270815 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-b1bdca16-39a2-4c6c-bbf4-34171d355323 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:07:03.272155 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-b1bdca16-39a2-4c6c-bbf4-34171d355323 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] 10.222.0.47 "GET /compute/v2.1/servers/dcb11872-0660-4e35-8d91-bfe80088844b" status: 200 len: 1717 microversion: 2.20 time: 0.466882 Feb 19 05:07:03.272752 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 471/940] 10.222.0.47 () {60 vars in 1267 bytes} [Fri Feb 19 05:07:02 2021] GET /compute/v2.1/servers/dcb11872-0660-4e35-8d91-bfe80088844b => generated 1717 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 19 05:07:03.278176 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [req-5cabd8dd-c3c1-4616-b896-324e1c61f83d req-99c95dc2-edd9-44ab-b001-fe3f931e492c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "309f67c8-0c6b-44ba-8084-7af7e889fb60", "tag": "a7ea70c1-0ec6-4ca5-a043-58240dd4372b"}]} {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:07:03.280291 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 05:07:03.280291 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: warnings.warn(msg) Feb 19 05:07:03.291890 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [req-5cabd8dd-c3c1-4616-b896-324e1c61f83d req-99c95dc2-edd9-44ab-b001-fe3f931e492c service nova] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:07:03.293005 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [req-5cabd8dd-c3c1-4616-b896-324e1c61f83d req-99c95dc2-edd9-44ab-b001-fe3f931e492c service nova] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:07:03.315084 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.compute.server_external_events [req-5cabd8dd-c3c1-4616-b896-324e1c61f83d req-99c95dc2-edd9-44ab-b001-fe3f931e492c service nova] Creating event network-changed:a7ea70c1-0ec6-4ca5-a043-58240dd4372b for instance 309f67c8-0c6b-44ba-8084-7af7e889fb60 on hv-cinder-77642 Feb 19 05:07:03.320505 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [req-5cabd8dd-c3c1-4616-b896-324e1c61f83d req-99c95dc2-edd9-44ab-b001-fe3f931e492c service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046236 Feb 19 05:07:03.321320 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 472/941] 10.222.0.47 () {64 vars in 1308 bytes} [Fri Feb 19 05:07:03 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 05:07:04.319841 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.network.neutron [None req-5d427ec9-8e17-4fb4-8af7-36bce434841e tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] [instance: 309f67c8-0c6b-44ba-8084-7af7e889fb60] Updating instance_info_cache with network_info: [{"id": "a7ea70c1-0ec6-4ca5-a043-58240dd4372b", "address": "fa:16:3e:60:18:eb", "network": {"id": "68c8736e-693c-40d6-962b-ec56c71786c4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-815410707-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.27.0.216", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "f87857a2fc3a4866a8055ed181d12edf", "mtu": 1450, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, "devname": "tapa7ea70c1-0e", "ovs_interfaceid": "a7ea70c1-0ec6-4ca5-a043-58240dd4372b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "meta": {}}] {{(pid=98153) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Feb 19 05:07:04.332144 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-5d427ec9-8e17-4fb4-8af7-36bce434841e tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Releasing lock "refresh_cache-309f67c8-0c6b-44ba-8084-7af7e889fb60" {{(pid=98153) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:282}} Feb 19 05:07:04.333083 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-5d427ec9-8e17-4fb4-8af7-36bce434841e tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] 10.222.0.47 "POST /compute/v2.1/servers/309f67c8-0c6b-44ba-8084-7af7e889fb60/action" status: 202 len: 0 microversion: 2.1 time: 4.068357 Feb 19 05:07:04.333757 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 470/942] 10.222.0.47 () {60 vars in 1268 bytes} [Fri Feb 19 05:07:00 2021] POST /compute/v2.1/servers/309f67c8-0c6b-44ba-8084-7af7e889fb60/action => generated 0 bytes in 4070 msecs (HTTP/1.1 202) 9 headers in 369 bytes (2 switches on core 0) Feb 19 05:07:07.425480 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-615e3e37-ea7e-4e13-ba50-2e282bcb4f4f tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:07:07.426641 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-615e3e37-ea7e-4e13-ba50-2e282bcb4f4f tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] [instance: f5e90100-1612-4e18-b86c-db90e3045760] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:07:07.435712 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-615e3e37-ea7e-4e13-ba50-2e282bcb4f4f tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:07:07.436392 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-615e3e37-ea7e-4e13-ba50-2e282bcb4f4f tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:07:07.437326 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-615e3e37-ea7e-4e13-ba50-2e282bcb4f4f tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:07:07.437886 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-615e3e37-ea7e-4e13-ba50-2e282bcb4f4f tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:07:07.510673 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-615e3e37-ea7e-4e13-ba50-2e282bcb4f4f tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] 10.222.0.47 "GET /compute/v2.1/servers/f5e90100-1612-4e18-b86c-db90e3045760/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.089767 Feb 19 05:07:07.511312 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 473/943] 10.222.0.47 () {58 vars in 1292 bytes} [Fri Feb 19 05:07:07 2021] GET /compute/v2.1/servers/f5e90100-1612-4e18-b86c-db90e3045760/os-volume_attachments => generated 371 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 05:07:07.717340 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-3d0d173e-69d3-42cd-a600-089f5848cb1a tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:07:07.717899 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-3d0d173e-69d3-42cd-a600-089f5848cb1a tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] [instance: f5e90100-1612-4e18-b86c-db90e3045760] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:07:07.726647 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-3d0d173e-69d3-42cd-a600-089f5848cb1a tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:07:07.727159 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-3d0d173e-69d3-42cd-a600-089f5848cb1a tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:07:07.728049 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-3d0d173e-69d3-42cd-a600-089f5848cb1a tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:07:07.728546 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-3d0d173e-69d3-42cd-a600-089f5848cb1a tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:07:07.800796 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-3d0d173e-69d3-42cd-a600-089f5848cb1a tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] 10.222.0.47 "GET /compute/v2.1/servers/f5e90100-1612-4e18-b86c-db90e3045760/os-volume_attachments/17b5dc6e-bd46-48bc-969e-b08d0f1f003d" status: 200 len: 194 microversion: 2.1 time: 0.088230 Feb 19 05:07:07.801454 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 471/944] 10.222.0.47 () {58 vars in 1403 bytes} [Fri Feb 19 05:07:07 2021] GET /compute/v2.1/servers/f5e90100-1612-4e18-b86c-db90e3045760/os-volume_attachments/17b5dc6e-bd46-48bc-969e-b08d0f1f003d => generated 194 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 05:07:07.812178 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-11826bc8-a13d-48b5-88ad-cb33264c8612 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:07:07.812719 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-11826bc8-a13d-48b5-88ad-cb33264c8612 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] [instance: f5e90100-1612-4e18-b86c-db90e3045760] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:07:07.820981 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-11826bc8-a13d-48b5-88ad-cb33264c8612 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:07:07.821504 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-11826bc8-a13d-48b5-88ad-cb33264c8612 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:07:07.822416 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-11826bc8-a13d-48b5-88ad-cb33264c8612 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:07:07.822949 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-11826bc8-a13d-48b5-88ad-cb33264c8612 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:07:08.013961 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.objects.instance [None req-11826bc8-a13d-48b5-88ad-cb33264c8612 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lazy-loading 'services' on Instance uuid f5e90100-1612-4e18-b86c-db90e3045760 {{(pid=98154) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Feb 19 05:07:08.164605 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-11826bc8-a13d-48b5-88ad-cb33264c8612 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] 10.222.0.47 "DELETE /compute/v2.1/servers/f5e90100-1612-4e18-b86c-db90e3045760/os-volume_attachments/17b5dc6e-bd46-48bc-969e-b08d0f1f003d" status: 202 len: 0 microversion: 2.1 time: 0.356409 Feb 19 05:07:08.165446 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 474/945] 10.222.0.47 () {58 vars in 1406 bytes} [Fri Feb 19 05:07:07 2021] DELETE /compute/v2.1/servers/f5e90100-1612-4e18-b86c-db90e3045760/os-volume_attachments/17b5dc6e-bd46-48bc-969e-b08d0f1f003d => generated 0 bytes in 358 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Feb 19 05:07:10.494381 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-76e6680f-06aa-4404-b501-2eebb22c7e82 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:07:10.494914 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-76e6680f-06aa-4404-b501-2eebb22c7e82 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] [instance: f5e90100-1612-4e18-b86c-db90e3045760] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:07:10.504139 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-76e6680f-06aa-4404-b501-2eebb22c7e82 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:07:10.504687 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-76e6680f-06aa-4404-b501-2eebb22c7e82 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:07:10.505647 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-76e6680f-06aa-4404-b501-2eebb22c7e82 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:07:10.506190 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-76e6680f-06aa-4404-b501-2eebb22c7e82 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:07:10.575596 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-76e6680f-06aa-4404-b501-2eebb22c7e82 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] 10.222.0.47 "GET /compute/v2.1/servers/f5e90100-1612-4e18-b86c-db90e3045760/os-volume_attachments/92049282-2f9f-4cdb-b07b-c8918a072292" status: 200 len: 194 microversion: 2.1 time: 0.084842 Feb 19 05:07:10.576245 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 472/946] 10.222.0.47 () {58 vars in 1403 bytes} [Fri Feb 19 05:07:10 2021] GET /compute/v2.1/servers/f5e90100-1612-4e18-b86c-db90e3045760/os-volume_attachments/92049282-2f9f-4cdb-b07b-c8918a072292 => generated 194 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 05:07:10.587585 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-6cd56e9f-fc11-49a1-822c-6603bb64df0c tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:07:10.588251 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-6cd56e9f-fc11-49a1-822c-6603bb64df0c tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] [instance: f5e90100-1612-4e18-b86c-db90e3045760] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:07:10.596445 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-6cd56e9f-fc11-49a1-822c-6603bb64df0c tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:07:10.596947 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-6cd56e9f-fc11-49a1-822c-6603bb64df0c tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:07:10.597786 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-6cd56e9f-fc11-49a1-822c-6603bb64df0c tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:07:10.598274 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-6cd56e9f-fc11-49a1-822c-6603bb64df0c tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:07:10.913599 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.objects.instance [None req-6cd56e9f-fc11-49a1-822c-6603bb64df0c tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lazy-loading 'services' on Instance uuid f5e90100-1612-4e18-b86c-db90e3045760 {{(pid=98154) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Feb 19 05:07:11.055709 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-6cd56e9f-fc11-49a1-822c-6603bb64df0c tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] 10.222.0.47 "DELETE /compute/v2.1/servers/f5e90100-1612-4e18-b86c-db90e3045760/os-volume_attachments/92049282-2f9f-4cdb-b07b-c8918a072292" status: 202 len: 0 microversion: 2.1 time: 0.472530 Feb 19 05:07:11.056400 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 475/947] 10.222.0.47 () {58 vars in 1406 bytes} [Fri Feb 19 05:07:10 2021] DELETE /compute/v2.1/servers/f5e90100-1612-4e18-b86c-db90e3045760/os-volume_attachments/92049282-2f9f-4cdb-b07b-c8918a072292 => generated 0 bytes in 474 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 19 05:07:12.688411 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-2d779b57-0a6e-4f11-9439-4300e276c2ef tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:07:12.688983 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-2d779b57-0a6e-4f11-9439-4300e276c2ef tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] [instance: f5e90100-1612-4e18-b86c-db90e3045760] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:07:12.697151 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-2d779b57-0a6e-4f11-9439-4300e276c2ef tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:07:12.697650 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-2d779b57-0a6e-4f11-9439-4300e276c2ef tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:07:12.698487 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-2d779b57-0a6e-4f11-9439-4300e276c2ef tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:07:12.699155 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-2d779b57-0a6e-4f11-9439-4300e276c2ef tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:07:12.764823 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-2d779b57-0a6e-4f11-9439-4300e276c2ef tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] [instance: f5e90100-1612-4e18-b86c-db90e3045760] Going to try to terminate instance {{(pid=98153) delete /opt/stack/nova/nova/compute/api.py:2540}} Feb 19 05:07:12.891388 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-2d779b57-0a6e-4f11-9439-4300e276c2ef tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] 10.222.0.47 "DELETE /compute/v2.1/servers/f5e90100-1612-4e18-b86c-db90e3045760" status: 204 len: 0 microversion: 2.1 time: 0.207223 Feb 19 05:07:12.892309 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 473/948] 10.222.0.47 () {58 vars in 1229 bytes} [Fri Feb 19 05:07:12 2021] DELETE /compute/v2.1/servers/f5e90100-1612-4e18-b86c-db90e3045760 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 19 05:07:12.907757 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-e5f1551e-e474-4142-909c-e70e63d5b2e6 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:07:12.909136 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-e5f1551e-e474-4142-909c-e70e63d5b2e6 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] [instance: f5e90100-1612-4e18-b86c-db90e3045760] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:07:12.925297 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-e5f1551e-e474-4142-909c-e70e63d5b2e6 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:07:12.926287 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-e5f1551e-e474-4142-909c-e70e63d5b2e6 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:07:12.927758 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-e5f1551e-e474-4142-909c-e70e63d5b2e6 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:07:12.928589 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-e5f1551e-e474-4142-909c-e70e63d5b2e6 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:07:13.180435 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-e5f1551e-e474-4142-909c-e70e63d5b2e6 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3274478c0a421895f43618dc827ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50941a0cab243e9a320ff22a7648de6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:07:13.190327 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-e5f1551e-e474-4142-909c-e70e63d5b2e6 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] 10.222.0.47 "GET /compute/v2.1/servers/f5e90100-1612-4e18-b86c-db90e3045760" status: 200 len: 1673 microversion: 2.1 time: 0.292579 Feb 19 05:07:13.190967 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 476/949] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:07:12 2021] GET /compute/v2.1/servers/f5e90100-1612-4e18-b86c-db90e3045760 => generated 1673 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:07:14.209717 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-d3e369e0-895d-4d13-9c88-3a142e3bc988 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:07:14.210487 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-d3e369e0-895d-4d13-9c88-3a142e3bc988 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] [instance: f5e90100-1612-4e18-b86c-db90e3045760] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:07:14.218652 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-d3e369e0-895d-4d13-9c88-3a142e3bc988 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:07:14.219160 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-d3e369e0-895d-4d13-9c88-3a142e3bc988 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:07:14.220040 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-d3e369e0-895d-4d13-9c88-3a142e3bc988 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:07:14.220531 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-d3e369e0-895d-4d13-9c88-3a142e3bc988 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:07:14.443680 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-d3e369e0-895d-4d13-9c88-3a142e3bc988 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3274478c0a421895f43618dc827ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50941a0cab243e9a320ff22a7648de6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:07:14.453396 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-d3e369e0-895d-4d13-9c88-3a142e3bc988 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] 10.222.0.47 "GET /compute/v2.1/servers/f5e90100-1612-4e18-b86c-db90e3045760" status: 200 len: 1673 microversion: 2.1 time: 0.248189 Feb 19 05:07:14.454038 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 474/950] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:07:14 2021] GET /compute/v2.1/servers/f5e90100-1612-4e18-b86c-db90e3045760 => generated 1673 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:07:15.473046 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-de79f39c-f25e-455b-b6d1-01e6d4011674 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:07:15.473883 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-de79f39c-f25e-455b-b6d1-01e6d4011674 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] [instance: f5e90100-1612-4e18-b86c-db90e3045760] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:07:15.483451 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-de79f39c-f25e-455b-b6d1-01e6d4011674 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:07:15.484225 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-de79f39c-f25e-455b-b6d1-01e6d4011674 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:07:15.485285 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-de79f39c-f25e-455b-b6d1-01e6d4011674 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:07:15.485976 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-de79f39c-f25e-455b-b6d1-01e6d4011674 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:07:16.086363 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-de79f39c-f25e-455b-b6d1-01e6d4011674 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3274478c0a421895f43618dc827ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50941a0cab243e9a320ff22a7648de6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:07:16.096924 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-de79f39c-f25e-455b-b6d1-01e6d4011674 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] 10.222.0.47 "GET /compute/v2.1/servers/f5e90100-1612-4e18-b86c-db90e3045760" status: 200 len: 1673 microversion: 2.1 time: 0.628242 Feb 19 05:07:16.097582 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 477/951] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:07:15 2021] GET /compute/v2.1/servers/f5e90100-1612-4e18-b86c-db90e3045760 => generated 1673 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:07:16.909791 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [req-78e93ef3-f430-44b1-a0f6-cf3486262b6d req-b571bdd0-1510-4ea1-b4f7-330162de3274 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5e90100-1612-4e18-b86c-db90e3045760", "name": "network-vif-deleted", "tag": "e40bbdec-f58a-4faa-a0b4-30939473013f"}]} {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:07:16.912928 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 05:07:16.912928 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: warnings.warn(msg) Feb 19 05:07:16.925519 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [req-78e93ef3-f430-44b1-a0f6-cf3486262b6d req-b571bdd0-1510-4ea1-b4f7-330162de3274 service nova] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:07:16.926027 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [req-78e93ef3-f430-44b1-a0f6-cf3486262b6d req-b571bdd0-1510-4ea1-b4f7-330162de3274 service nova] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:07:16.991005 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.compute.server_external_events [req-78e93ef3-f430-44b1-a0f6-cf3486262b6d req-b571bdd0-1510-4ea1-b4f7-330162de3274 service nova] Creating event network-vif-deleted:e40bbdec-f58a-4faa-a0b4-30939473013f for instance f5e90100-1612-4e18-b86c-db90e3045760 on hv-cinder-77642 Feb 19 05:07:16.997583 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [req-78e93ef3-f430-44b1-a0f6-cf3486262b6d req-b571bdd0-1510-4ea1-b4f7-330162de3274 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093545 Feb 19 05:07:16.999309 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 475/952] 10.222.0.47 () {64 vars in 1308 bytes} [Fri Feb 19 05:07:16 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 05:07:17.116403 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-de260a8c-cafe-4fef-8e5d-0ad4edccd72e tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:07:17.117077 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-de260a8c-cafe-4fef-8e5d-0ad4edccd72e tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] [instance: f5e90100-1612-4e18-b86c-db90e3045760] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:07:17.126508 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-de260a8c-cafe-4fef-8e5d-0ad4edccd72e tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:07:17.127085 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-de260a8c-cafe-4fef-8e5d-0ad4edccd72e tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:07:17.127922 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-de260a8c-cafe-4fef-8e5d-0ad4edccd72e tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:07:17.128424 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-de260a8c-cafe-4fef-8e5d-0ad4edccd72e tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:07:17.206818 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-de260a8c-cafe-4fef-8e5d-0ad4edccd72e tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:07:17.207406 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-de260a8c-cafe-4fef-8e5d-0ad4edccd72e tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:07:17.208100 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.objects.instance [None req-de260a8c-cafe-4fef-8e5d-0ad4edccd72e tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lazy-loading 'fault' on Instance uuid f5e90100-1612-4e18-b86c-db90e3045760 {{(pid=98154) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Feb 19 05:07:17.297180 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-de260a8c-cafe-4fef-8e5d-0ad4edccd72e tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3274478c0a421895f43618dc827ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50941a0cab243e9a320ff22a7648de6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:07:17.306466 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-de260a8c-cafe-4fef-8e5d-0ad4edccd72e tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] 10.222.0.47 "GET /compute/v2.1/servers/f5e90100-1612-4e18-b86c-db90e3045760" status: 200 len: 1326 microversion: 2.1 time: 0.194125 Feb 19 05:07:17.307121 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 478/953] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:07:17 2021] GET /compute/v2.1/servers/f5e90100-1612-4e18-b86c-db90e3045760 => generated 1326 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:07:18.331842 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-0c89e0ee-a708-427e-adfc-b1ff6b49942e tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:07:18.333173 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-0c89e0ee-a708-427e-adfc-b1ff6b49942e tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] [instance: f5e90100-1612-4e18-b86c-db90e3045760] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:07:18.349699 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-0c89e0ee-a708-427e-adfc-b1ff6b49942e tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:07:18.350602 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-0c89e0ee-a708-427e-adfc-b1ff6b49942e tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:07:18.352189 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-0c89e0ee-a708-427e-adfc-b1ff6b49942e tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:07:18.353109 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-0c89e0ee-a708-427e-adfc-b1ff6b49942e tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:07:18.415795 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.wsgi [None req-0c89e0ee-a708-427e-adfc-b1ff6b49942e tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] HTTP exception thrown: Instance f5e90100-1612-4e18-b86c-db90e3045760 could not be found. Feb 19 05:07:18.416468 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-0c89e0ee-a708-427e-adfc-b1ff6b49942e tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Returning 404 to user: Instance f5e90100-1612-4e18-b86c-db90e3045760 could not be found. {{(pid=98153) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 19 05:07:18.417383 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-0c89e0ee-a708-427e-adfc-b1ff6b49942e tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] 10.222.0.47 "GET /compute/v2.1/servers/f5e90100-1612-4e18-b86c-db90e3045760" status: 404 len: 111 microversion: 2.1 time: 0.093657 Feb 19 05:07:18.418009 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 476/954] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:07:18 2021] GET /compute/v2.1/servers/f5e90100-1612-4e18-b86c-db90e3045760 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 05:07:18.429102 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-940304ce-6c5a-4b9f-8626-b66e04016935 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Calling method '.version_select at 0x7f2706821048>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:07:18.449459 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-940304ce-6c5a-4b9f-8626-b66e04016935 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-291383576" status: 202 len: 0 microversion: 2.1 time: 0.025204 Feb 19 05:07:18.450101 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 479/955] 10.222.0.47 () {58 vars in 1208 bytes} [Fri Feb 19 05:07:18 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-291383576 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 19 05:07:23.428511 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-4f1bc9b9-8ecf-4496-b9eb-5f5d1bf4c51b tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:07:23.429113 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-4f1bc9b9-8ecf-4496-b9eb-5f5d1bf4c51b tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] [instance: f5e90100-1612-4e18-b86c-db90e3045760] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:07:23.437479 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-4f1bc9b9-8ecf-4496-b9eb-5f5d1bf4c51b tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:07:23.437992 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-4f1bc9b9-8ecf-4496-b9eb-5f5d1bf4c51b tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:07:23.438846 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-4f1bc9b9-8ecf-4496-b9eb-5f5d1bf4c51b tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:07:23.439371 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-4f1bc9b9-8ecf-4496-b9eb-5f5d1bf4c51b tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:07:23.496819 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.wsgi [None req-4f1bc9b9-8ecf-4496-b9eb-5f5d1bf4c51b tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] HTTP exception thrown: Instance f5e90100-1612-4e18-b86c-db90e3045760 could not be found. Feb 19 05:07:23.497577 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-4f1bc9b9-8ecf-4496-b9eb-5f5d1bf4c51b tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Returning 404 to user: Instance f5e90100-1612-4e18-b86c-db90e3045760 could not be found. {{(pid=98153) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 19 05:07:23.498714 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-4f1bc9b9-8ecf-4496-b9eb-5f5d1bf4c51b tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] 10.222.0.47 "DELETE /compute/v2.1/servers/f5e90100-1612-4e18-b86c-db90e3045760" status: 404 len: 111 microversion: 2.1 time: 0.074289 Feb 19 05:07:23.499352 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 477/956] 10.222.0.47 () {58 vars in 1229 bytes} [Fri Feb 19 05:07:23 2021] DELETE /compute/v2.1/servers/f5e90100-1612-4e18-b86c-db90e3045760 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 05:07:23.508053 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-10cb9b44-48be-4714-bae3-f2bf6b2ad826 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:07:23.508720 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-10cb9b44-48be-4714-bae3-f2bf6b2ad826 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] [instance: f5e90100-1612-4e18-b86c-db90e3045760] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:07:23.517579 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-10cb9b44-48be-4714-bae3-f2bf6b2ad826 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:07:23.518089 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-10cb9b44-48be-4714-bae3-f2bf6b2ad826 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:07:23.518931 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-10cb9b44-48be-4714-bae3-f2bf6b2ad826 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:07:23.519465 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-10cb9b44-48be-4714-bae3-f2bf6b2ad826 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:07:23.572132 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.wsgi [None req-10cb9b44-48be-4714-bae3-f2bf6b2ad826 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] HTTP exception thrown: Instance f5e90100-1612-4e18-b86c-db90e3045760 could not be found. Feb 19 05:07:23.572792 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-10cb9b44-48be-4714-bae3-f2bf6b2ad826 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Returning 404 to user: Instance f5e90100-1612-4e18-b86c-db90e3045760 could not be found. {{(pid=98154) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 19 05:07:23.573696 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-10cb9b44-48be-4714-bae3-f2bf6b2ad826 tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] 10.222.0.47 "GET /compute/v2.1/servers/f5e90100-1612-4e18-b86c-db90e3045760" status: 404 len: 111 microversion: 2.1 time: 0.069771 Feb 19 05:07:23.574317 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 480/957] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:07:23 2021] GET /compute/v2.1/servers/f5e90100-1612-4e18-b86c-db90e3045760 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 05:07:24.830158 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-ba17abbd-e571-4e29-a59f-12a25a4f212e tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:07:24.830712 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-ba17abbd-e571-4e29-a59f-12a25a4f212e tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] [instance: be65ea57-bc8d-4bce-80c3-33d8b6007ed1] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:07:24.839011 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-ba17abbd-e571-4e29-a59f-12a25a4f212e tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:07:24.839553 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-ba17abbd-e571-4e29-a59f-12a25a4f212e tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:07:24.840399 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-ba17abbd-e571-4e29-a59f-12a25a4f212e tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:07:24.840892 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-ba17abbd-e571-4e29-a59f-12a25a4f212e tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:07:24.899190 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.wsgi [None req-ba17abbd-e571-4e29-a59f-12a25a4f212e tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] HTTP exception thrown: Instance be65ea57-bc8d-4bce-80c3-33d8b6007ed1 could not be found. Feb 19 05:07:24.899896 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-ba17abbd-e571-4e29-a59f-12a25a4f212e tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Returning 404 to user: Instance be65ea57-bc8d-4bce-80c3-33d8b6007ed1 could not be found. {{(pid=98153) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 19 05:07:24.900809 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-ba17abbd-e571-4e29-a59f-12a25a4f212e tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] 10.222.0.47 "DELETE /compute/v2.1/servers/be65ea57-bc8d-4bce-80c3-33d8b6007ed1" status: 404 len: 111 microversion: 2.1 time: 0.076612 Feb 19 05:07:24.901436 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 478/958] 10.222.0.47 () {58 vars in 1229 bytes} [Fri Feb 19 05:07:24 2021] DELETE /compute/v2.1/servers/be65ea57-bc8d-4bce-80c3-33d8b6007ed1 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 05:07:24.911592 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-c0463c94-a62f-43b5-8da0-de314729d23d tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:07:24.912389 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-c0463c94-a62f-43b5-8da0-de314729d23d tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] [instance: be65ea57-bc8d-4bce-80c3-33d8b6007ed1] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:07:24.925679 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-c0463c94-a62f-43b5-8da0-de314729d23d tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:07:24.926198 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-c0463c94-a62f-43b5-8da0-de314729d23d tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:07:24.927090 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-c0463c94-a62f-43b5-8da0-de314729d23d tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:07:24.927618 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-c0463c94-a62f-43b5-8da0-de314729d23d tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:07:24.984401 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.wsgi [None req-c0463c94-a62f-43b5-8da0-de314729d23d tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] HTTP exception thrown: Instance be65ea57-bc8d-4bce-80c3-33d8b6007ed1 could not be found. Feb 19 05:07:24.985078 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-c0463c94-a62f-43b5-8da0-de314729d23d tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] Returning 404 to user: Instance be65ea57-bc8d-4bce-80c3-33d8b6007ed1 could not be found. {{(pid=98154) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 19 05:07:24.985984 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-c0463c94-a62f-43b5-8da0-de314729d23d tempest-AttachVolumeTestJSON-1948888196 tempest-AttachVolumeTestJSON-1948888196-project] 10.222.0.47 "GET /compute/v2.1/servers/be65ea57-bc8d-4bce-80c3-33d8b6007ed1" status: 404 len: 111 microversion: 2.1 time: 0.078762 Feb 19 05:07:24.986605 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 481/959] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:07:24 2021] GET /compute/v2.1/servers/be65ea57-bc8d-4bce-80c3-33d8b6007ed1 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 05:07:36.973474 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-0695d8c5-d870-4e48-949f-d76b33ebaabd tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:07:36.974015 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-0695d8c5-d870-4e48-949f-d76b33ebaabd tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] [instance: dcb11872-0660-4e35-8d91-bfe80088844b] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:07:36.983565 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-0695d8c5-d870-4e48-949f-d76b33ebaabd tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:07:36.984080 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-0695d8c5-d870-4e48-949f-d76b33ebaabd tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:07:36.984922 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-0695d8c5-d870-4e48-949f-d76b33ebaabd tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:07:36.985648 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-0695d8c5-d870-4e48-949f-d76b33ebaabd tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:07:37.053496 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-0695d8c5-d870-4e48-949f-d76b33ebaabd tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] [instance: dcb11872-0660-4e35-8d91-bfe80088844b] Going to try to terminate instance {{(pid=98153) delete /opt/stack/nova/nova/compute/api.py:2540}} Feb 19 05:07:37.180400 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-0695d8c5-d870-4e48-949f-d76b33ebaabd tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] 10.222.0.47 "DELETE /compute/v2.1/servers/dcb11872-0660-4e35-8d91-bfe80088844b" status: 204 len: 0 microversion: 2.20 time: 0.210515 Feb 19 05:07:37.181101 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 479/960] 10.222.0.47 () {60 vars in 1270 bytes} [Fri Feb 19 05:07:36 2021] DELETE /compute/v2.1/servers/dcb11872-0660-4e35-8d91-bfe80088844b => generated 0 bytes in 212 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Feb 19 05:07:37.191454 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-afbf188e-e588-4664-ad1d-1f2c354c9968 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:07:37.192128 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-afbf188e-e588-4664-ad1d-1f2c354c9968 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] [instance: dcb11872-0660-4e35-8d91-bfe80088844b] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:07:37.200447 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-afbf188e-e588-4664-ad1d-1f2c354c9968 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:07:37.201099 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-afbf188e-e588-4664-ad1d-1f2c354c9968 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:07:37.202089 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-afbf188e-e588-4664-ad1d-1f2c354c9968 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:07:37.202626 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-afbf188e-e588-4664-ad1d-1f2c354c9968 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:07:37.434344 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-afbf188e-e588-4664-ad1d-1f2c354c9968 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:07:37.444998 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-afbf188e-e588-4664-ad1d-1f2c354c9968 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:07:37.446791 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-afbf188e-e588-4664-ad1d-1f2c354c9968 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:07:37.448286 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-afbf188e-e588-4664-ad1d-1f2c354c9968 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] 10.222.0.47 "GET /compute/v2.1/servers/dcb11872-0660-4e35-8d91-bfe80088844b" status: 200 len: 1723 microversion: 2.20 time: 0.261176 Feb 19 05:07:37.448907 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 482/961] 10.222.0.47 () {60 vars in 1267 bytes} [Fri Feb 19 05:07:37 2021] GET /compute/v2.1/servers/dcb11872-0660-4e35-8d91-bfe80088844b => generated 1723 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 05:07:38.470316 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-d184de3f-1170-49a6-a4bd-33979a48d57b tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:07:38.471289 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-d184de3f-1170-49a6-a4bd-33979a48d57b tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] [instance: dcb11872-0660-4e35-8d91-bfe80088844b] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:07:38.479602 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-d184de3f-1170-49a6-a4bd-33979a48d57b tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:07:38.480123 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-d184de3f-1170-49a6-a4bd-33979a48d57b tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:07:38.480982 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-d184de3f-1170-49a6-a4bd-33979a48d57b tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:07:38.481574 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-d184de3f-1170-49a6-a4bd-33979a48d57b tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:07:38.771052 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-d184de3f-1170-49a6-a4bd-33979a48d57b tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:07:38.781426 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-d184de3f-1170-49a6-a4bd-33979a48d57b tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:07:38.783009 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-d184de3f-1170-49a6-a4bd-33979a48d57b tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:07:38.784343 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-d184de3f-1170-49a6-a4bd-33979a48d57b tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] 10.222.0.47 "GET /compute/v2.1/servers/dcb11872-0660-4e35-8d91-bfe80088844b" status: 200 len: 1723 microversion: 2.20 time: 0.319579 Feb 19 05:07:38.785006 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 480/962] 10.222.0.47 () {60 vars in 1267 bytes} [Fri Feb 19 05:07:38 2021] GET /compute/v2.1/servers/dcb11872-0660-4e35-8d91-bfe80088844b => generated 1723 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 19 05:07:39.812132 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-ee5b0d72-c700-4190-83de-470de279a418 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:07:39.813511 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-ee5b0d72-c700-4190-83de-470de279a418 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] [instance: dcb11872-0660-4e35-8d91-bfe80088844b] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:07:39.831047 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-ee5b0d72-c700-4190-83de-470de279a418 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:07:39.832536 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-ee5b0d72-c700-4190-83de-470de279a418 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:07:39.834201 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-ee5b0d72-c700-4190-83de-470de279a418 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:07:39.835142 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-ee5b0d72-c700-4190-83de-470de279a418 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:07:40.403186 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-ee5b0d72-c700-4190-83de-470de279a418 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:07:40.414397 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-ee5b0d72-c700-4190-83de-470de279a418 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:07:40.416242 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-ee5b0d72-c700-4190-83de-470de279a418 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:07:40.417740 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-ee5b0d72-c700-4190-83de-470de279a418 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] 10.222.0.47 "GET /compute/v2.1/servers/dcb11872-0660-4e35-8d91-bfe80088844b" status: 200 len: 1723 microversion: 2.20 time: 0.615101 Feb 19 05:07:40.418577 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 483/963] 10.222.0.47 () {60 vars in 1267 bytes} [Fri Feb 19 05:07:39 2021] GET /compute/v2.1/servers/dcb11872-0660-4e35-8d91-bfe80088844b => generated 1723 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 05:07:40.949174 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [req-e2e9c83b-254c-4b9e-8e2b-86c1bfca57b2 req-6671b0ab-2aaf-4859-be9a-13500d585039 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dcb11872-0660-4e35-8d91-bfe80088844b", "name": "network-vif-deleted", "tag": "02a5dd6b-46b0-46bc-b05b-eb9f66823a35"}]} {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:07:40.950887 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 05:07:40.950887 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: warnings.warn(msg) Feb 19 05:07:40.966062 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [req-e2e9c83b-254c-4b9e-8e2b-86c1bfca57b2 req-6671b0ab-2aaf-4859-be9a-13500d585039 service nova] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:07:40.966665 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [req-e2e9c83b-254c-4b9e-8e2b-86c1bfca57b2 req-6671b0ab-2aaf-4859-be9a-13500d585039 service nova] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:07:41.008535 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.compute.server_external_events [req-e2e9c83b-254c-4b9e-8e2b-86c1bfca57b2 req-6671b0ab-2aaf-4859-be9a-13500d585039 service nova] Creating event network-vif-deleted:02a5dd6b-46b0-46bc-b05b-eb9f66823a35 for instance dcb11872-0660-4e35-8d91-bfe80088844b on hv-cinder-77642 Feb 19 05:07:41.014517 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [req-e2e9c83b-254c-4b9e-8e2b-86c1bfca57b2 req-6671b0ab-2aaf-4859-be9a-13500d585039 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069645 Feb 19 05:07:41.019168 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 481/964] 10.222.0.47 () {64 vars in 1308 bytes} [Fri Feb 19 05:07:40 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 19 05:07:41.444309 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-c2c23499-9c6a-402b-9802-d708a521392b tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:07:41.446310 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-c2c23499-9c6a-402b-9802-d708a521392b tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] [instance: dcb11872-0660-4e35-8d91-bfe80088844b] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:07:41.464034 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-c2c23499-9c6a-402b-9802-d708a521392b tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:07:41.466325 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-c2c23499-9c6a-402b-9802-d708a521392b tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:07:41.468497 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-c2c23499-9c6a-402b-9802-d708a521392b tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:07:41.469468 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-c2c23499-9c6a-402b-9802-d708a521392b tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:07:41.554816 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-c2c23499-9c6a-402b-9802-d708a521392b tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:07:41.555622 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-c2c23499-9c6a-402b-9802-d708a521392b tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:07:41.556141 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.objects.instance [None req-c2c23499-9c6a-402b-9802-d708a521392b tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lazy-loading 'fault' on Instance uuid dcb11872-0660-4e35-8d91-bfe80088844b {{(pid=98154) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Feb 19 05:07:41.727355 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-c2c23499-9c6a-402b-9802-d708a521392b tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:07:41.747769 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-c2c23499-9c6a-402b-9802-d708a521392b tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:07:41.750576 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-c2c23499-9c6a-402b-9802-d708a521392b tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62fa02eb0f4e42b3a536230807e2786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2441d2c3fda643489d511f8ba26e9755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:07:41.753020 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-c2c23499-9c6a-402b-9802-d708a521392b tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] 10.222.0.47 "GET /compute/v2.1/servers/dcb11872-0660-4e35-8d91-bfe80088844b" status: 200 len: 1371 microversion: 2.20 time: 0.317050 Feb 19 05:07:41.763900 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 484/965] 10.222.0.47 () {60 vars in 1267 bytes} [Fri Feb 19 05:07:41 2021] GET /compute/v2.1/servers/dcb11872-0660-4e35-8d91-bfe80088844b => generated 1371 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 05:07:42.786522 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-36259c89-dd4e-45c5-be46-1278e979c9b3 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:07:42.787533 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-36259c89-dd4e-45c5-be46-1278e979c9b3 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] [instance: dcb11872-0660-4e35-8d91-bfe80088844b] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:07:42.797331 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-36259c89-dd4e-45c5-be46-1278e979c9b3 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:07:42.797825 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-36259c89-dd4e-45c5-be46-1278e979c9b3 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:07:42.798917 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-36259c89-dd4e-45c5-be46-1278e979c9b3 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:07:42.799613 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-36259c89-dd4e-45c5-be46-1278e979c9b3 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:07:42.854749 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.wsgi [None req-36259c89-dd4e-45c5-be46-1278e979c9b3 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] HTTP exception thrown: Instance dcb11872-0660-4e35-8d91-bfe80088844b could not be found. Feb 19 05:07:42.855467 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-36259c89-dd4e-45c5-be46-1278e979c9b3 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Returning 404 to user: Instance dcb11872-0660-4e35-8d91-bfe80088844b could not be found. {{(pid=98153) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 19 05:07:42.857273 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-36259c89-dd4e-45c5-be46-1278e979c9b3 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] 10.222.0.47 "GET /compute/v2.1/servers/dcb11872-0660-4e35-8d91-bfe80088844b" status: 404 len: 111 microversion: 2.20 time: 0.074625 Feb 19 05:07:42.860855 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 482/966] 10.222.0.47 () {60 vars in 1267 bytes} [Fri Feb 19 05:07:42 2021] GET /compute/v2.1/servers/dcb11872-0660-4e35-8d91-bfe80088844b => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Feb 19 05:07:42.866885 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-5010abda-6219-4287-98a3-8098ee5f3ba9 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Calling method '.version_select at 0x7f270723bae8>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:07:42.884647 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-5010abda-6219-4287-98a3-8098ee5f3ba9 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1501241439" status: 204 len: 0 microversion: 2.20 time: 0.021599 Feb 19 05:07:42.885546 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 485/967] 10.222.0.47 () {60 vars in 1252 bytes} [Fri Feb 19 05:07:42 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1501241439 => generated 0 bytes in 23 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Feb 19 05:07:45.708485 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-064494eb-1476-4ef0-b06b-ea359673bc76 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:07:45.708485 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-064494eb-1476-4ef0-b06b-ea359673bc76 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] [instance: dcb11872-0660-4e35-8d91-bfe80088844b] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:07:45.715924 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-064494eb-1476-4ef0-b06b-ea359673bc76 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:07:45.716480 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-064494eb-1476-4ef0-b06b-ea359673bc76 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:07:45.717684 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-064494eb-1476-4ef0-b06b-ea359673bc76 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:07:45.717801 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-064494eb-1476-4ef0-b06b-ea359673bc76 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:07:45.779242 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.wsgi [None req-064494eb-1476-4ef0-b06b-ea359673bc76 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] HTTP exception thrown: Instance dcb11872-0660-4e35-8d91-bfe80088844b could not be found. Feb 19 05:07:45.779978 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-064494eb-1476-4ef0-b06b-ea359673bc76 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Returning 404 to user: Instance dcb11872-0660-4e35-8d91-bfe80088844b could not be found. {{(pid=98153) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 19 05:07:45.780896 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-064494eb-1476-4ef0-b06b-ea359673bc76 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] 10.222.0.47 "DELETE /compute/v2.1/servers/dcb11872-0660-4e35-8d91-bfe80088844b" status: 404 len: 111 microversion: 2.1 time: 0.077652 Feb 19 05:07:45.781674 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 483/968] 10.222.0.47 () {58 vars in 1229 bytes} [Fri Feb 19 05:07:45 2021] DELETE /compute/v2.1/servers/dcb11872-0660-4e35-8d91-bfe80088844b => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 05:07:45.790161 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-633581ad-e618-4507-b7e8-b27dd9c72b9b tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:07:45.790877 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-633581ad-e618-4507-b7e8-b27dd9c72b9b tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] [instance: dcb11872-0660-4e35-8d91-bfe80088844b] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:07:45.798978 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-633581ad-e618-4507-b7e8-b27dd9c72b9b tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:07:45.799530 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-633581ad-e618-4507-b7e8-b27dd9c72b9b tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:07:45.800389 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-633581ad-e618-4507-b7e8-b27dd9c72b9b tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:07:45.800882 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-633581ad-e618-4507-b7e8-b27dd9c72b9b tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:07:45.859150 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.wsgi [None req-633581ad-e618-4507-b7e8-b27dd9c72b9b tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] HTTP exception thrown: Instance dcb11872-0660-4e35-8d91-bfe80088844b could not be found. Feb 19 05:07:45.859875 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-633581ad-e618-4507-b7e8-b27dd9c72b9b tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Returning 404 to user: Instance dcb11872-0660-4e35-8d91-bfe80088844b could not be found. {{(pid=98154) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 19 05:07:45.860779 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-633581ad-e618-4507-b7e8-b27dd9c72b9b tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] 10.222.0.47 "GET /compute/v2.1/servers/dcb11872-0660-4e35-8d91-bfe80088844b" status: 404 len: 111 microversion: 2.1 time: 0.074855 Feb 19 05:07:45.861399 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 486/969] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:07:45 2021] GET /compute/v2.1/servers/dcb11872-0660-4e35-8d91-bfe80088844b => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 05:07:47.147352 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-116a3484-d9d0-4932-ac7a-e4623e70b766 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:07:47.147908 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-116a3484-d9d0-4932-ac7a-e4623e70b766 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] [instance: 798b77ff-c3ca-4c65-a120-db12ad953621] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:07:47.156653 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-116a3484-d9d0-4932-ac7a-e4623e70b766 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:07:47.157159 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-116a3484-d9d0-4932-ac7a-e4623e70b766 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:07:47.158003 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-116a3484-d9d0-4932-ac7a-e4623e70b766 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:07:47.158498 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-116a3484-d9d0-4932-ac7a-e4623e70b766 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:07:47.214628 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.wsgi [None req-116a3484-d9d0-4932-ac7a-e4623e70b766 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] HTTP exception thrown: Instance 798b77ff-c3ca-4c65-a120-db12ad953621 could not be found. Feb 19 05:07:47.215291 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-116a3484-d9d0-4932-ac7a-e4623e70b766 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Returning 404 to user: Instance 798b77ff-c3ca-4c65-a120-db12ad953621 could not be found. {{(pid=98153) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 19 05:07:47.216898 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-116a3484-d9d0-4932-ac7a-e4623e70b766 tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] 10.222.0.47 "DELETE /compute/v2.1/servers/798b77ff-c3ca-4c65-a120-db12ad953621" status: 404 len: 111 microversion: 2.1 time: 0.073604 Feb 19 05:07:47.217508 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 484/970] 10.222.0.47 () {58 vars in 1229 bytes} [Fri Feb 19 05:07:47 2021] DELETE /compute/v2.1/servers/798b77ff-c3ca-4c65-a120-db12ad953621 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 05:07:47.226409 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-ae8a165b-1eaf-482e-8449-ff4e2515a7dc tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:07:47.227078 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-ae8a165b-1eaf-482e-8449-ff4e2515a7dc tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] [instance: 798b77ff-c3ca-4c65-a120-db12ad953621] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:07:47.235926 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-ae8a165b-1eaf-482e-8449-ff4e2515a7dc tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:07:47.236703 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-ae8a165b-1eaf-482e-8449-ff4e2515a7dc tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:07:47.237225 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-ae8a165b-1eaf-482e-8449-ff4e2515a7dc tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:07:47.237713 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-ae8a165b-1eaf-482e-8449-ff4e2515a7dc tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:07:47.290552 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.wsgi [None req-ae8a165b-1eaf-482e-8449-ff4e2515a7dc tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] HTTP exception thrown: Instance 798b77ff-c3ca-4c65-a120-db12ad953621 could not be found. Feb 19 05:07:47.291225 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-ae8a165b-1eaf-482e-8449-ff4e2515a7dc tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] Returning 404 to user: Instance 798b77ff-c3ca-4c65-a120-db12ad953621 could not be found. {{(pid=98154) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 19 05:07:47.292169 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-ae8a165b-1eaf-482e-8449-ff4e2515a7dc tempest-AttachVolumeShelveTestJSON-199101433 tempest-AttachVolumeShelveTestJSON-199101433-project] 10.222.0.47 "GET /compute/v2.1/servers/798b77ff-c3ca-4c65-a120-db12ad953621" status: 404 len: 111 microversion: 2.1 time: 0.069948 Feb 19 05:07:47.292787 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 487/971] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:07:47 2021] GET /compute/v2.1/servers/798b77ff-c3ca-4c65-a120-db12ad953621 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 05:07:57.992969 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-01f42fe3-f323-4c02-86a5-a3c0d924b1c9 tempest-VolumesGetTestJSON-1219119170 tempest-VolumesGetTestJSON-1219119170-project] Action: 'create', calling method: .version_select at 0x7f27066217b8>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-338455971", "metadata": {"Type": "work"}}} {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:07:58.580954 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-01f42fe3-f323-4c02-86a5-a3c0d924b1c9 tempest-VolumesGetTestJSON-1219119170 tempest-VolumesGetTestJSON-1219119170-project] 10.222.0.47 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 0.955681 Feb 19 05:07:58.581773 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 485/972] 10.222.0.47 () {60 vars in 1146 bytes} [Fri Feb 19 05:07:57 2021] POST /compute/v2.1/os-volumes => generated 352 bytes in 958 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Feb 19 05:07:58.593947 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-25e815f1-a8d2-41bd-ad7f-fdc2e5ca11a2 tempest-VolumesGetTestJSON-1219119170 tempest-VolumesGetTestJSON-1219119170-project] Calling method '.version_select at 0x7f270723b8c8>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:07:58.703223 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-25e815f1-a8d2-41bd-ad7f-fdc2e5ca11a2 tempest-VolumesGetTestJSON-1219119170 tempest-VolumesGetTestJSON-1219119170-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/810eda0c-8dee-4437-90a4-d55ab6b72917" status: 200 len: 352 microversion: 2.1 time: 0.113135 Feb 19 05:07:58.703684 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 488/973] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Feb 19 05:07:58 2021] GET /compute/v2.1/os-volumes/810eda0c-8dee-4437-90a4-d55ab6b72917 => generated 352 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 05:07:59.718904 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-e1501c1f-9963-4893-a48f-fa1787576f24 tempest-VolumesGetTestJSON-1219119170 tempest-VolumesGetTestJSON-1219119170-project] Calling method '.version_select at 0x7f27066211e0>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:07:59.829739 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-e1501c1f-9963-4893-a48f-fa1787576f24 tempest-VolumesGetTestJSON-1219119170 tempest-VolumesGetTestJSON-1219119170-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/810eda0c-8dee-4437-90a4-d55ab6b72917" status: 200 len: 353 microversion: 2.1 time: 0.117070 Feb 19 05:07:59.830371 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 486/974] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Feb 19 05:07:59 2021] GET /compute/v2.1/os-volumes/810eda0c-8dee-4437-90a4-d55ab6b72917 => generated 353 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 05:07:59.842654 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-8f44e3e0-153f-4ffa-b382-e0a19eea2cc7 tempest-VolumesGetTestJSON-1219119170 tempest-VolumesGetTestJSON-1219119170-project] Calling method '.version_select at 0x7f2706821620>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:07:59.947840 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-8f44e3e0-153f-4ffa-b382-e0a19eea2cc7 tempest-VolumesGetTestJSON-1219119170 tempest-VolumesGetTestJSON-1219119170-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/810eda0c-8dee-4437-90a4-d55ab6b72917" status: 200 len: 353 microversion: 2.1 time: 0.109640 Feb 19 05:07:59.948742 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 489/975] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Feb 19 05:07:59 2021] GET /compute/v2.1/os-volumes/810eda0c-8dee-4437-90a4-d55ab6b72917 => generated 353 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 05:07:59.969380 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-67a7b68f-ef1a-4620-b9ba-1df709f3ce32 tempest-VolumesGetTestJSON-1219119170 tempest-VolumesGetTestJSON-1219119170-project] Calling method '.version_select at 0x7f27067ca1e0>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:08:00.074456 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-67a7b68f-ef1a-4620-b9ba-1df709f3ce32 tempest-VolumesGetTestJSON-1219119170 tempest-VolumesGetTestJSON-1219119170-project] 10.222.0.47 "DELETE /compute/v2.1/os-volumes/810eda0c-8dee-4437-90a4-d55ab6b72917" status: 202 len: 0 microversion: 2.1 time: 0.109534 Feb 19 05:08:00.076238 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 487/976] 10.222.0.47 () {58 vars in 1238 bytes} [Fri Feb 19 05:07:59 2021] DELETE /compute/v2.1/os-volumes/810eda0c-8dee-4437-90a4-d55ab6b72917 => generated 0 bytes in 113 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 19 05:08:00.084909 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-6a6d383b-8f41-479e-ac00-f979190923d7 tempest-VolumesGetTestJSON-1219119170 tempest-VolumesGetTestJSON-1219119170-project] Calling method '.version_select at 0x7f270723bbf8>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:08:00.192810 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-6a6d383b-8f41-479e-ac00-f979190923d7 tempest-VolumesGetTestJSON-1219119170 tempest-VolumesGetTestJSON-1219119170-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/810eda0c-8dee-4437-90a4-d55ab6b72917" status: 200 len: 352 microversion: 2.1 time: 0.111636 Feb 19 05:08:00.193674 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 490/977] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Feb 19 05:08:00 2021] GET /compute/v2.1/os-volumes/810eda0c-8dee-4437-90a4-d55ab6b72917 => generated 352 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 05:08:01.208349 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-5e8d6228-67ec-4a4c-84a1-d9c87bd71f23 tempest-VolumesGetTestJSON-1219119170 tempest-VolumesGetTestJSON-1219119170-project] Calling method '.version_select at 0x7f27067ca598>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:08:01.285714 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.wsgi [None req-5e8d6228-67ec-4a4c-84a1-d9c87bd71f23 tempest-VolumesGetTestJSON-1219119170 tempest-VolumesGetTestJSON-1219119170-project] HTTP exception thrown: Volume 810eda0c-8dee-4437-90a4-d55ab6b72917 could not be found. Feb 19 05:08:01.286381 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-5e8d6228-67ec-4a4c-84a1-d9c87bd71f23 tempest-VolumesGetTestJSON-1219119170 tempest-VolumesGetTestJSON-1219119170-project] Returning 404 to user: Volume 810eda0c-8dee-4437-90a4-d55ab6b72917 could not be found. {{(pid=98153) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 19 05:08:01.287291 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-5e8d6228-67ec-4a4c-84a1-d9c87bd71f23 tempest-VolumesGetTestJSON-1219119170 tempest-VolumesGetTestJSON-1219119170-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/810eda0c-8dee-4437-90a4-d55ab6b72917" status: 404 len: 109 microversion: 2.1 time: 0.084056 Feb 19 05:08:01.287960 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 488/978] 10.222.0.47 () {58 vars in 1235 bytes} [Fri Feb 19 05:08:01 2021] GET /compute/v2.1/os-volumes/810eda0c-8dee-4437-90a4-d55ab6b72917 => generated 109 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 05:08:28.472327 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 19 05:08:28.472942 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: Fri Feb 19 05:08:28 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 19 05:08:59.059767 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-ab753326-d7c1-425c-9a91-89c6c0dc2e6e tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:08:59.060339 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-ab753326-d7c1-425c-9a91-89c6c0dc2e6e tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] [instance: 309f67c8-0c6b-44ba-8084-7af7e889fb60] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:08:59.068535 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-ab753326-d7c1-425c-9a91-89c6c0dc2e6e tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:08:59.069043 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-ab753326-d7c1-425c-9a91-89c6c0dc2e6e tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:08:59.069892 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-ab753326-d7c1-425c-9a91-89c6c0dc2e6e tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:08:59.070378 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-ab753326-d7c1-425c-9a91-89c6c0dc2e6e tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:08:59.140373 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-ab753326-d7c1-425c-9a91-89c6c0dc2e6e tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] [instance: 309f67c8-0c6b-44ba-8084-7af7e889fb60] Going to try to terminate instance {{(pid=98154) delete /opt/stack/nova/nova/compute/api.py:2540}} Feb 19 05:08:59.255897 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-ab753326-d7c1-425c-9a91-89c6c0dc2e6e tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] 10.222.0.47 "DELETE /compute/v2.1/servers/309f67c8-0c6b-44ba-8084-7af7e889fb60" status: 204 len: 0 microversion: 2.1 time: 0.199742 Feb 19 05:08:59.256565 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 491/979] 10.222.0.47 () {58 vars in 1229 bytes} [Fri Feb 19 05:08:59 2021] DELETE /compute/v2.1/servers/309f67c8-0c6b-44ba-8084-7af7e889fb60 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 19 05:08:59.268886 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-24658e8a-c014-47bf-84e7-545c27fa5414 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:08:59.269578 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-24658e8a-c014-47bf-84e7-545c27fa5414 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] [instance: 309f67c8-0c6b-44ba-8084-7af7e889fb60] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:08:59.278789 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-24658e8a-c014-47bf-84e7-545c27fa5414 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:08:59.279307 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-24658e8a-c014-47bf-84e7-545c27fa5414 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:08:59.280181 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-24658e8a-c014-47bf-84e7-545c27fa5414 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:08:59.280688 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-24658e8a-c014-47bf-84e7-545c27fa5414 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:08:59.494272 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-24658e8a-c014-47bf-84e7-545c27fa5414 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32f894b7dad5447688fb395e08d31d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87857a2fc3a4866a8055ed181d12edf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:08:59.503857 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-24658e8a-c014-47bf-84e7-545c27fa5414 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] 10.222.0.47 "GET /compute/v2.1/servers/309f67c8-0c6b-44ba-8084-7af7e889fb60" status: 200 len: 1585 microversion: 2.1 time: 0.242564 Feb 19 05:08:59.504470 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 489/980] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:08:59 2021] GET /compute/v2.1/servers/309f67c8-0c6b-44ba-8084-7af7e889fb60 => generated 1585 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:09:00.523182 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-a167d419-7928-4a43-9eec-4e4772390500 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:09:00.524007 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-a167d419-7928-4a43-9eec-4e4772390500 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] [instance: 309f67c8-0c6b-44ba-8084-7af7e889fb60] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:09:00.532885 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-a167d419-7928-4a43-9eec-4e4772390500 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:09:00.533385 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-a167d419-7928-4a43-9eec-4e4772390500 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:09:00.534214 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-a167d419-7928-4a43-9eec-4e4772390500 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:09:00.534700 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-a167d419-7928-4a43-9eec-4e4772390500 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:09:00.761500 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-a167d419-7928-4a43-9eec-4e4772390500 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32f894b7dad5447688fb395e08d31d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87857a2fc3a4866a8055ed181d12edf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:09:00.770962 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-a167d419-7928-4a43-9eec-4e4772390500 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] 10.222.0.47 "GET /compute/v2.1/servers/309f67c8-0c6b-44ba-8084-7af7e889fb60" status: 200 len: 1585 microversion: 2.1 time: 0.252303 Feb 19 05:09:00.771636 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 492/981] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:09:00 2021] GET /compute/v2.1/servers/309f67c8-0c6b-44ba-8084-7af7e889fb60 => generated 1585 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:09:01.755587 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [req-ad7157cd-68ad-463a-b744-03a90a06a57d req-7a1afbc1-cef8-4b63-a18b-d3b02cf9e089 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "309f67c8-0c6b-44ba-8084-7af7e889fb60", "name": "network-vif-unplugged", "status": "completed", "tag": "a7ea70c1-0ec6-4ca5-a043-58240dd4372b"}]} {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:09:01.757583 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 05:09:01.757583 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: warnings.warn(msg) Feb 19 05:09:01.770455 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [req-ad7157cd-68ad-463a-b744-03a90a06a57d req-7a1afbc1-cef8-4b63-a18b-d3b02cf9e089 service nova] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:09:01.771400 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [req-ad7157cd-68ad-463a-b744-03a90a06a57d req-7a1afbc1-cef8-4b63-a18b-d3b02cf9e089 service nova] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:09:01.790076 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-366bdc47-979a-494a-9ac9-d4798253efc0 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:09:01.790751 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-366bdc47-979a-494a-9ac9-d4798253efc0 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] [instance: 309f67c8-0c6b-44ba-8084-7af7e889fb60] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:09:01.793896 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.compute.server_external_events [req-ad7157cd-68ad-463a-b744-03a90a06a57d req-7a1afbc1-cef8-4b63-a18b-d3b02cf9e089 service nova] Creating event network-vif-unplugged:a7ea70c1-0ec6-4ca5-a043-58240dd4372b for instance 309f67c8-0c6b-44ba-8084-7af7e889fb60 on hv-cinder-77642 Feb 19 05:09:01.799935 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [req-ad7157cd-68ad-463a-b744-03a90a06a57d req-7a1afbc1-cef8-4b63-a18b-d3b02cf9e089 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048739 Feb 19 05:09:01.801165 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 490/982] 10.222.0.47 () {64 vars in 1308 bytes} [Fri Feb 19 05:09:01 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 05:09:01.810341 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-366bdc47-979a-494a-9ac9-d4798253efc0 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:09:01.810870 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-366bdc47-979a-494a-9ac9-d4798253efc0 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:09:01.811819 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-366bdc47-979a-494a-9ac9-d4798253efc0 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:09:01.812287 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-366bdc47-979a-494a-9ac9-d4798253efc0 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:09:02.058584 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-366bdc47-979a-494a-9ac9-d4798253efc0 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32f894b7dad5447688fb395e08d31d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87857a2fc3a4866a8055ed181d12edf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:09:02.068117 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-366bdc47-979a-494a-9ac9-d4798253efc0 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] 10.222.0.47 "GET /compute/v2.1/servers/309f67c8-0c6b-44ba-8084-7af7e889fb60" status: 200 len: 1585 microversion: 2.1 time: 0.282286 Feb 19 05:09:02.068759 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 493/983] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:09:01 2021] GET /compute/v2.1/servers/309f67c8-0c6b-44ba-8084-7af7e889fb60 => generated 1585 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:09:03.087545 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-5bc4a86d-ba8d-4075-8e27-ee10a312fdc8 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:09:03.088499 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-5bc4a86d-ba8d-4075-8e27-ee10a312fdc8 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] [instance: 309f67c8-0c6b-44ba-8084-7af7e889fb60] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:09:03.097322 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-5bc4a86d-ba8d-4075-8e27-ee10a312fdc8 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:09:03.098092 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-5bc4a86d-ba8d-4075-8e27-ee10a312fdc8 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:09:03.099116 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-5bc4a86d-ba8d-4075-8e27-ee10a312fdc8 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:09:03.099785 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-5bc4a86d-ba8d-4075-8e27-ee10a312fdc8 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:09:03.541214 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-5bc4a86d-ba8d-4075-8e27-ee10a312fdc8 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32f894b7dad5447688fb395e08d31d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87857a2fc3a4866a8055ed181d12edf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:09:03.551238 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-5bc4a86d-ba8d-4075-8e27-ee10a312fdc8 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] 10.222.0.47 "GET /compute/v2.1/servers/309f67c8-0c6b-44ba-8084-7af7e889fb60" status: 200 len: 1510 microversion: 2.1 time: 0.468612 Feb 19 05:09:03.551805 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 491/984] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:09:03 2021] GET /compute/v2.1/servers/309f67c8-0c6b-44ba-8084-7af7e889fb60 => generated 1510 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:09:04.101996 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [req-c172253c-efa7-459a-96f2-ef523fa03fca req-2b804461-b804-4588-be5d-6111dde95900 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "309f67c8-0c6b-44ba-8084-7af7e889fb60", "name": "network-vif-deleted", "tag": "a7ea70c1-0ec6-4ca5-a043-58240dd4372b"}]} {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:09:04.103930 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 05:09:04.103930 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: warnings.warn(msg) Feb 19 05:09:04.122189 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [req-c172253c-efa7-459a-96f2-ef523fa03fca req-2b804461-b804-4588-be5d-6111dde95900 service nova] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:09:04.122994 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [req-c172253c-efa7-459a-96f2-ef523fa03fca req-2b804461-b804-4588-be5d-6111dde95900 service nova] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:09:04.146800 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.compute.server_external_events [req-c172253c-efa7-459a-96f2-ef523fa03fca req-2b804461-b804-4588-be5d-6111dde95900 service nova] Creating event network-vif-deleted:a7ea70c1-0ec6-4ca5-a043-58240dd4372b for instance 309f67c8-0c6b-44ba-8084-7af7e889fb60 on hv-cinder-77642 Feb 19 05:09:04.153097 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [req-c172253c-efa7-459a-96f2-ef523fa03fca req-2b804461-b804-4588-be5d-6111dde95900 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054816 Feb 19 05:09:04.157773 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 494/985] 10.222.0.47 () {64 vars in 1308 bytes} [Fri Feb 19 05:09:04 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 05:09:04.570361 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-b88d96c2-2e9c-4228-8289-b23583a1c8ce tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:09:04.571223 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-b88d96c2-2e9c-4228-8289-b23583a1c8ce tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] [instance: 309f67c8-0c6b-44ba-8084-7af7e889fb60] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:09:04.580893 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-b88d96c2-2e9c-4228-8289-b23583a1c8ce tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:09:04.581645 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-b88d96c2-2e9c-4228-8289-b23583a1c8ce tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:09:04.582491 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-b88d96c2-2e9c-4228-8289-b23583a1c8ce tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:09:04.582956 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-b88d96c2-2e9c-4228-8289-b23583a1c8ce tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:09:04.736724 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-b88d96c2-2e9c-4228-8289-b23583a1c8ce tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32f894b7dad5447688fb395e08d31d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87857a2fc3a4866a8055ed181d12edf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:09:04.747192 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-b88d96c2-2e9c-4228-8289-b23583a1c8ce tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] 10.222.0.47 "GET /compute/v2.1/servers/309f67c8-0c6b-44ba-8084-7af7e889fb60" status: 200 len: 1226 microversion: 2.1 time: 0.180843 Feb 19 05:09:04.748216 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 492/986] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:09:04 2021] GET /compute/v2.1/servers/309f67c8-0c6b-44ba-8084-7af7e889fb60 => generated 1226 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:09:05.766973 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-fe74596d-f099-4d14-8e97-1c685ba4c0c4 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:09:05.767788 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-fe74596d-f099-4d14-8e97-1c685ba4c0c4 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] [instance: 309f67c8-0c6b-44ba-8084-7af7e889fb60] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:09:05.775865 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-fe74596d-f099-4d14-8e97-1c685ba4c0c4 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:09:05.776400 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-fe74596d-f099-4d14-8e97-1c685ba4c0c4 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:09:05.777219 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-fe74596d-f099-4d14-8e97-1c685ba4c0c4 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:09:05.777702 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-fe74596d-f099-4d14-8e97-1c685ba4c0c4 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:09:05.833270 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.wsgi [None req-fe74596d-f099-4d14-8e97-1c685ba4c0c4 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] HTTP exception thrown: Instance 309f67c8-0c6b-44ba-8084-7af7e889fb60 could not be found. Feb 19 05:09:05.833940 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-fe74596d-f099-4d14-8e97-1c685ba4c0c4 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Returning 404 to user: Instance 309f67c8-0c6b-44ba-8084-7af7e889fb60 could not be found. {{(pid=98154) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 19 05:09:05.834837 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-fe74596d-f099-4d14-8e97-1c685ba4c0c4 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] 10.222.0.47 "GET /compute/v2.1/servers/309f67c8-0c6b-44ba-8084-7af7e889fb60" status: 404 len: 111 microversion: 2.1 time: 0.072724 Feb 19 05:09:05.835670 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 495/987] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:09:05 2021] GET /compute/v2.1/servers/309f67c8-0c6b-44ba-8084-7af7e889fb60 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 05:09:05.957834 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-b8881dc1-1de4-4278-9f5c-28c0852297d6 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-108351924", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1012313419", "security_groups": [{"name": "tempest-TestVolumeBootPattern-1266909124"}], "block_device_mapping_v2": [{"uuid": "c2734bdb-d4ac-4b6f-bd61-5a937f3de60d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "68c8736e-693c-40d6-962b-ec56c71786c4"}]}} {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:09:06.142534 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.network.neutron [None req-b8881dc1-1de4-4278-9f5c-28c0852297d6 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] validate_networks() for [('68c8736e-693c-40d6-962b-ec56c71786c4', None, None, None)] {{(pid=98153) validate_networks /opt/stack/nova/nova/network/neutron.py:2345}} Feb 19 05:09:06.753669 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.virt.hardware [None req-b8881dc1-1de4-4278-9f5c-28c0852297d6 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Flavor limits 0:0:0 {{(pid=98153) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 19 05:09:06.754185 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.virt.hardware [None req-b8881dc1-1de4-4278-9f5c-28c0852297d6 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Image limits 0:0:0 {{(pid=98153) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Feb 19 05:09:06.754755 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.virt.hardware [None req-b8881dc1-1de4-4278-9f5c-28c0852297d6 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Flavor pref 0:0:0 {{(pid=98153) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 19 05:09:06.755210 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.virt.hardware [None req-b8881dc1-1de4-4278-9f5c-28c0852297d6 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Image pref 0:0:0 {{(pid=98153) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Feb 19 05:09:06.755700 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.virt.hardware [None req-b8881dc1-1de4-4278-9f5c-28c0852297d6 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98153) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Feb 19 05:09:06.765381 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-b8881dc1-1de4-4278-9f5c-28c0852297d6 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:09:06.765879 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-b8881dc1-1de4-4278-9f5c-28c0852297d6 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:09:06.766775 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-b8881dc1-1de4-4278-9f5c-28c0852297d6 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:09:06.767285 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-b8881dc1-1de4-4278-9f5c-28c0852297d6 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:09:06.785214 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.quota [None req-b8881dc1-1de4-4278-9f5c-28c0852297d6 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Getting quotas for project f87857a2fc3a4866a8055ed181d12edf. Resources: {'instances', 'ram', 'cores'} {{(pid=98153) _get_quotas /opt/stack/nova/nova/quota.py:388}} Feb 19 05:09:06.789376 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.quota [None req-b8881dc1-1de4-4278-9f5c-28c0852297d6 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Getting quotas for user 32f894b7dad5447688fb395e08d31d4c and project f87857a2fc3a4866a8055ed181d12edf. Resources: {'instances', 'ram', 'cores'} {{(pid=98153) _get_quotas /opt/stack/nova/nova/quota.py:380}} Feb 19 05:09:06.902594 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-b8881dc1-1de4-4278-9f5c-28c0852297d6 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Going to run 1 instances... {{(pid=98153) _provision_instances /opt/stack/nova/nova/compute/api.py:1264}} Feb 19 05:09:06.905417 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-b8881dc1-1de4-4278-9f5c-28c0852297d6 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] [instance: 9a73fc48-03e5-457a-9ca7-a88320b99dea] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c2734bdb-d4ac-4b6f-bd61-5a937f3de60d',volume_size=None,volume_type=None)] {{(pid=98153) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1666}} Feb 19 05:09:07.084793 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-b8881dc1-1de4-4278-9f5c-28c0852297d6 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 413 microversion: 2.1 time: 1.130934 Feb 19 05:09:07.085499 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 493/988] 10.222.0.47 () {60 vars in 1137 bytes} [Fri Feb 19 05:09:05 2021] POST /compute/v2.1/servers => generated 413 bytes in 1132 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 19 05:09:07.096899 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-64d692d1-0ce6-4119-ac3c-9eeac163aa16 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:09:07.097566 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-64d692d1-0ce6-4119-ac3c-9eeac163aa16 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] [instance: 9a73fc48-03e5-457a-9ca7-a88320b99dea] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:09:07.177299 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-64d692d1-0ce6-4119-ac3c-9eeac163aa16 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32f894b7dad5447688fb395e08d31d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87857a2fc3a4866a8055ed181d12edf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:09:07.185861 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-64d692d1-0ce6-4119-ac3c-9eeac163aa16 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] 10.222.0.47 "GET /compute/v2.1/servers/9a73fc48-03e5-457a-9ca7-a88320b99dea" status: 200 len: 1094 microversion: 2.1 time: 0.092993 Feb 19 05:09:07.186530 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 496/989] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:09:07 2021] GET /compute/v2.1/servers/9a73fc48-03e5-457a-9ca7-a88320b99dea => generated 1094 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:09:08.205117 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-c1c5d37f-b08b-4616-980d-829f0f466005 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:09:08.205867 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-c1c5d37f-b08b-4616-980d-829f0f466005 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] [instance: 9a73fc48-03e5-457a-9ca7-a88320b99dea] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:09:08.287813 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-c1c5d37f-b08b-4616-980d-829f0f466005 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32f894b7dad5447688fb395e08d31d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87857a2fc3a4866a8055ed181d12edf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:09:08.296291 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-c1c5d37f-b08b-4616-980d-829f0f466005 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] 10.222.0.47 "GET /compute/v2.1/servers/9a73fc48-03e5-457a-9ca7-a88320b99dea" status: 200 len: 1094 microversion: 2.1 time: 0.095341 Feb 19 05:09:08.297104 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 494/990] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:09:08 2021] GET /compute/v2.1/servers/9a73fc48-03e5-457a-9ca7-a88320b99dea => generated 1094 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:09:09.314619 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-4ee82860-90db-416a-9bc7-b4bff32792d4 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:09:09.315297 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-4ee82860-90db-416a-9bc7-b4bff32792d4 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] [instance: 9a73fc48-03e5-457a-9ca7-a88320b99dea] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:09:09.398084 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-4ee82860-90db-416a-9bc7-b4bff32792d4 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32f894b7dad5447688fb395e08d31d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87857a2fc3a4866a8055ed181d12edf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:09:09.406221 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-4ee82860-90db-416a-9bc7-b4bff32792d4 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] 10.222.0.47 "GET /compute/v2.1/servers/9a73fc48-03e5-457a-9ca7-a88320b99dea" status: 200 len: 1094 microversion: 2.1 time: 0.095750 Feb 19 05:09:09.406896 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 497/991] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:09:09 2021] GET /compute/v2.1/servers/9a73fc48-03e5-457a-9ca7-a88320b99dea => generated 1094 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:09:10.424868 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-81909fb2-154e-4e87-821a-82d55ba49727 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:09:10.426671 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-81909fb2-154e-4e87-821a-82d55ba49727 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] [instance: 9a73fc48-03e5-457a-9ca7-a88320b99dea] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:09:10.510482 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-81909fb2-154e-4e87-821a-82d55ba49727 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32f894b7dad5447688fb395e08d31d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87857a2fc3a4866a8055ed181d12edf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:09:10.519294 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-81909fb2-154e-4e87-821a-82d55ba49727 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] 10.222.0.47 "GET /compute/v2.1/servers/9a73fc48-03e5-457a-9ca7-a88320b99dea" status: 200 len: 1094 microversion: 2.1 time: 0.098419 Feb 19 05:09:10.520017 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 495/992] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:09:10 2021] GET /compute/v2.1/servers/9a73fc48-03e5-457a-9ca7-a88320b99dea => generated 1094 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:09:11.538057 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-c3c3a331-14f3-4db3-9842-3005f2d2b1fd tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:09:11.538737 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-c3c3a331-14f3-4db3-9842-3005f2d2b1fd tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] [instance: 9a73fc48-03e5-457a-9ca7-a88320b99dea] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:09:11.546837 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-c3c3a331-14f3-4db3-9842-3005f2d2b1fd tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:09:11.547368 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-c3c3a331-14f3-4db3-9842-3005f2d2b1fd tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:09:11.548291 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-c3c3a331-14f3-4db3-9842-3005f2d2b1fd tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:09:11.548787 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-c3c3a331-14f3-4db3-9842-3005f2d2b1fd tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:09:11.679131 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-c3c3a331-14f3-4db3-9842-3005f2d2b1fd tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32f894b7dad5447688fb395e08d31d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87857a2fc3a4866a8055ed181d12edf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:09:11.689050 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-c3c3a331-14f3-4db3-9842-3005f2d2b1fd tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] 10.222.0.47 "GET /compute/v2.1/servers/9a73fc48-03e5-457a-9ca7-a88320b99dea" status: 200 len: 1144 microversion: 2.1 time: 0.155057 Feb 19 05:09:11.689699 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 498/993] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:09:11 2021] GET /compute/v2.1/servers/9a73fc48-03e5-457a-9ca7-a88320b99dea => generated 1144 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:09:12.708965 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-3965b17a-bb2f-4e52-8458-573902305696 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:09:12.710080 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-3965b17a-bb2f-4e52-8458-573902305696 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] [instance: 9a73fc48-03e5-457a-9ca7-a88320b99dea] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:09:12.719279 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-3965b17a-bb2f-4e52-8458-573902305696 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:09:12.719933 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-3965b17a-bb2f-4e52-8458-573902305696 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:09:12.721028 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-3965b17a-bb2f-4e52-8458-573902305696 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:09:12.721633 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-3965b17a-bb2f-4e52-8458-573902305696 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:09:12.923039 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-3965b17a-bb2f-4e52-8458-573902305696 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32f894b7dad5447688fb395e08d31d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87857a2fc3a4866a8055ed181d12edf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:09:12.935682 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-3965b17a-bb2f-4e52-8458-573902305696 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] 10.222.0.47 "GET /compute/v2.1/servers/9a73fc48-03e5-457a-9ca7-a88320b99dea" status: 200 len: 1210 microversion: 2.1 time: 0.230750 Feb 19 05:09:12.939410 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 496/994] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:09:12 2021] GET /compute/v2.1/servers/9a73fc48-03e5-457a-9ca7-a88320b99dea => generated 1210 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 05:09:13.961436 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-25c54f34-b7d8-454a-97ab-41bad76ed0eb tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:09:13.963037 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-25c54f34-b7d8-454a-97ab-41bad76ed0eb tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] [instance: 9a73fc48-03e5-457a-9ca7-a88320b99dea] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:09:13.976887 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-25c54f34-b7d8-454a-97ab-41bad76ed0eb tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:09:13.977745 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-25c54f34-b7d8-454a-97ab-41bad76ed0eb tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:09:13.979990 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-25c54f34-b7d8-454a-97ab-41bad76ed0eb tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:09:13.980864 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-25c54f34-b7d8-454a-97ab-41bad76ed0eb tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:09:14.442848 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-25c54f34-b7d8-454a-97ab-41bad76ed0eb tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32f894b7dad5447688fb395e08d31d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87857a2fc3a4866a8055ed181d12edf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:09:14.453101 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-25c54f34-b7d8-454a-97ab-41bad76ed0eb tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] 10.222.0.47 "GET /compute/v2.1/servers/9a73fc48-03e5-457a-9ca7-a88320b99dea" status: 200 len: 1273 microversion: 2.1 time: 0.498340 Feb 19 05:09:14.454000 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 499/995] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:09:13 2021] GET /compute/v2.1/servers/9a73fc48-03e5-457a-9ca7-a88320b99dea => generated 1273 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:09:15.476086 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-078b3b2f-6864-4fc5-99a4-618a4eb04975 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:09:15.477455 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-078b3b2f-6864-4fc5-99a4-618a4eb04975 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] [instance: 9a73fc48-03e5-457a-9ca7-a88320b99dea] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:09:15.486553 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-078b3b2f-6864-4fc5-99a4-618a4eb04975 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:09:15.487509 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-078b3b2f-6864-4fc5-99a4-618a4eb04975 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:09:15.488502 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-078b3b2f-6864-4fc5-99a4-618a4eb04975 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:09:15.489243 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-078b3b2f-6864-4fc5-99a4-618a4eb04975 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:09:15.951724 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [req-970d3a53-71ed-4b88-bee9-556858cfd53e req-16eb11d6-a4d5-48af-a545-5c84d28eb3b2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9a73fc48-03e5-457a-9ca7-a88320b99dea", "tag": "40c60130-4312-40cf-8192-b2d69af35fa4"}]} {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:09:15.953592 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 05:09:15.953592 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: warnings.warn(msg) Feb 19 05:09:15.974541 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [req-970d3a53-71ed-4b88-bee9-556858cfd53e req-16eb11d6-a4d5-48af-a545-5c84d28eb3b2 service nova] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:09:15.975558 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [req-970d3a53-71ed-4b88-bee9-556858cfd53e req-16eb11d6-a4d5-48af-a545-5c84d28eb3b2 service nova] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:09:16.013341 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.compute.server_external_events [req-970d3a53-71ed-4b88-bee9-556858cfd53e req-16eb11d6-a4d5-48af-a545-5c84d28eb3b2 service nova] Creating event network-changed:40c60130-4312-40cf-8192-b2d69af35fa4 for instance 9a73fc48-03e5-457a-9ca7-a88320b99dea on hv-cinder-77642 Feb 19 05:09:16.018870 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [req-970d3a53-71ed-4b88-bee9-556858cfd53e req-16eb11d6-a4d5-48af-a545-5c84d28eb3b2 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072461 Feb 19 05:09:16.019801 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 500/996] 10.222.0.47 () {64 vars in 1308 bytes} [Fri Feb 19 05:09:15 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 05:09:16.085848 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-078b3b2f-6864-4fc5-99a4-618a4eb04975 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32f894b7dad5447688fb395e08d31d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87857a2fc3a4866a8055ed181d12edf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:09:16.099965 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-078b3b2f-6864-4fc5-99a4-618a4eb04975 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] 10.222.0.47 "GET /compute/v2.1/servers/9a73fc48-03e5-457a-9ca7-a88320b99dea" status: 200 len: 1273 microversion: 2.1 time: 0.628177 Feb 19 05:09:16.100622 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 497/997] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:09:15 2021] GET /compute/v2.1/servers/9a73fc48-03e5-457a-9ca7-a88320b99dea => generated 1273 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:09:17.119101 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-5a631185-b667-4510-8280-8c769d7d9cdd tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:09:17.119964 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-5a631185-b667-4510-8280-8c769d7d9cdd tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] [instance: 9a73fc48-03e5-457a-9ca7-a88320b99dea] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:09:17.128918 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-5a631185-b667-4510-8280-8c769d7d9cdd tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:09:17.129428 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-5a631185-b667-4510-8280-8c769d7d9cdd tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:09:17.130459 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-5a631185-b667-4510-8280-8c769d7d9cdd tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:09:17.130963 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-5a631185-b667-4510-8280-8c769d7d9cdd tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:09:17.503450 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-5a631185-b667-4510-8280-8c769d7d9cdd tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32f894b7dad5447688fb395e08d31d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87857a2fc3a4866a8055ed181d12edf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:09:17.513120 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-5a631185-b667-4510-8280-8c769d7d9cdd tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] 10.222.0.47 "GET /compute/v2.1/servers/9a73fc48-03e5-457a-9ca7-a88320b99dea" status: 200 len: 1273 microversion: 2.1 time: 0.398283 Feb 19 05:09:17.513768 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 501/998] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:09:17 2021] GET /compute/v2.1/servers/9a73fc48-03e5-457a-9ca7-a88320b99dea => generated 1273 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:09:18.532206 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-324c7bac-7e62-4d6c-b5ae-ca6ea82733dd tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:09:18.532871 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-324c7bac-7e62-4d6c-b5ae-ca6ea82733dd tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] [instance: 9a73fc48-03e5-457a-9ca7-a88320b99dea] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:09:18.540765 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-324c7bac-7e62-4d6c-b5ae-ca6ea82733dd tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:09:18.541279 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-324c7bac-7e62-4d6c-b5ae-ca6ea82733dd tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:09:18.542120 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-324c7bac-7e62-4d6c-b5ae-ca6ea82733dd tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:09:18.542625 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-324c7bac-7e62-4d6c-b5ae-ca6ea82733dd tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:09:18.775599 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-324c7bac-7e62-4d6c-b5ae-ca6ea82733dd tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32f894b7dad5447688fb395e08d31d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87857a2fc3a4866a8055ed181d12edf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:09:18.785032 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-324c7bac-7e62-4d6c-b5ae-ca6ea82733dd tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] 10.222.0.47 "GET /compute/v2.1/servers/9a73fc48-03e5-457a-9ca7-a88320b99dea" status: 200 len: 1273 microversion: 2.1 time: 0.256674 Feb 19 05:09:18.785612 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 498/999] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:09:18 2021] GET /compute/v2.1/servers/9a73fc48-03e5-457a-9ca7-a88320b99dea => generated 1273 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:09:19.805888 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-9cdf90a7-e0ec-43cf-8184-b775ca7f275f tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:09:19.806783 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-9cdf90a7-e0ec-43cf-8184-b775ca7f275f tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] [instance: 9a73fc48-03e5-457a-9ca7-a88320b99dea] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:09:19.814854 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-9cdf90a7-e0ec-43cf-8184-b775ca7f275f tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:09:19.815384 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-9cdf90a7-e0ec-43cf-8184-b775ca7f275f tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:09:19.816240 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-9cdf90a7-e0ec-43cf-8184-b775ca7f275f tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:09:19.816734 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-9cdf90a7-e0ec-43cf-8184-b775ca7f275f tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:09:20.046644 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-9cdf90a7-e0ec-43cf-8184-b775ca7f275f tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32f894b7dad5447688fb395e08d31d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87857a2fc3a4866a8055ed181d12edf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:09:20.055866 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-9cdf90a7-e0ec-43cf-8184-b775ca7f275f tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] 10.222.0.47 "GET /compute/v2.1/servers/9a73fc48-03e5-457a-9ca7-a88320b99dea" status: 200 len: 1273 microversion: 2.1 time: 0.254853 Feb 19 05:09:20.056546 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 502/1000] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:09:19 2021] GET /compute/v2.1/servers/9a73fc48-03e5-457a-9ca7-a88320b99dea => generated 1273 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:09:21.074973 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-4f4038f3-facb-4b63-923c-d0c6664f6410 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:09:21.075690 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-4f4038f3-facb-4b63-923c-d0c6664f6410 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] [instance: 9a73fc48-03e5-457a-9ca7-a88320b99dea] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:09:21.083718 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-4f4038f3-facb-4b63-923c-d0c6664f6410 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:09:21.084233 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-4f4038f3-facb-4b63-923c-d0c6664f6410 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:09:21.085076 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-4f4038f3-facb-4b63-923c-d0c6664f6410 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:09:21.085567 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-4f4038f3-facb-4b63-923c-d0c6664f6410 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:09:21.497628 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-4f4038f3-facb-4b63-923c-d0c6664f6410 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32f894b7dad5447688fb395e08d31d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87857a2fc3a4866a8055ed181d12edf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:09:21.506973 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-4f4038f3-facb-4b63-923c-d0c6664f6410 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] 10.222.0.47 "GET /compute/v2.1/servers/9a73fc48-03e5-457a-9ca7-a88320b99dea" status: 200 len: 1273 microversion: 2.1 time: 0.436139 Feb 19 05:09:21.507661 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 499/1001] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:09:21 2021] GET /compute/v2.1/servers/9a73fc48-03e5-457a-9ca7-a88320b99dea => generated 1273 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:09:22.525625 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-31d225a3-6fbe-4649-ad9f-8c08d4d1d0fa tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:09:22.526287 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-31d225a3-6fbe-4649-ad9f-8c08d4d1d0fa tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] [instance: 9a73fc48-03e5-457a-9ca7-a88320b99dea] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:09:22.534777 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-31d225a3-6fbe-4649-ad9f-8c08d4d1d0fa tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:09:22.535283 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-31d225a3-6fbe-4649-ad9f-8c08d4d1d0fa tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:09:22.536141 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-31d225a3-6fbe-4649-ad9f-8c08d4d1d0fa tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:09:22.536632 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-31d225a3-6fbe-4649-ad9f-8c08d4d1d0fa tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:09:22.815290 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-31d225a3-6fbe-4649-ad9f-8c08d4d1d0fa tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32f894b7dad5447688fb395e08d31d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87857a2fc3a4866a8055ed181d12edf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:09:22.825693 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-31d225a3-6fbe-4649-ad9f-8c08d4d1d0fa tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] 10.222.0.47 "GET /compute/v2.1/servers/9a73fc48-03e5-457a-9ca7-a88320b99dea" status: 200 len: 1273 microversion: 2.1 time: 0.304085 Feb 19 05:09:22.826329 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 503/1002] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:09:22 2021] GET /compute/v2.1/servers/9a73fc48-03e5-457a-9ca7-a88320b99dea => generated 1273 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:09:23.844351 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-4d54cd85-14a9-4d6e-8c34-d231d6b7c96f tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:09:23.845014 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-4d54cd85-14a9-4d6e-8c34-d231d6b7c96f tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] [instance: 9a73fc48-03e5-457a-9ca7-a88320b99dea] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:09:23.853623 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-4d54cd85-14a9-4d6e-8c34-d231d6b7c96f tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:09:23.854139 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-4d54cd85-14a9-4d6e-8c34-d231d6b7c96f tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:09:23.855683 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-4d54cd85-14a9-4d6e-8c34-d231d6b7c96f tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:09:23.856178 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-4d54cd85-14a9-4d6e-8c34-d231d6b7c96f tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:09:24.087319 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-4d54cd85-14a9-4d6e-8c34-d231d6b7c96f tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32f894b7dad5447688fb395e08d31d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87857a2fc3a4866a8055ed181d12edf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:09:24.097566 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-4d54cd85-14a9-4d6e-8c34-d231d6b7c96f tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] 10.222.0.47 "GET /compute/v2.1/servers/9a73fc48-03e5-457a-9ca7-a88320b99dea" status: 200 len: 1273 microversion: 2.1 time: 0.257130 Feb 19 05:09:24.098221 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 500/1003] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:09:23 2021] GET /compute/v2.1/servers/9a73fc48-03e5-457a-9ca7-a88320b99dea => generated 1273 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:09:24.648498 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [req-2190639c-3467-49d2-ac3c-7e4dca6958ea req-73504288-8228-4fbb-b590-503e5f09d3ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a73fc48-03e5-457a-9ca7-a88320b99dea", "name": "network-vif-plugged", "status": "completed", "tag": "40c60130-4312-40cf-8192-b2d69af35fa4"}]} {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:09:24.655428 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 05:09:24.655428 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: warnings.warn(msg) Feb 19 05:09:24.674036 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [req-2190639c-3467-49d2-ac3c-7e4dca6958ea req-73504288-8228-4fbb-b590-503e5f09d3ca service nova] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:09:24.674993 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [req-2190639c-3467-49d2-ac3c-7e4dca6958ea req-73504288-8228-4fbb-b590-503e5f09d3ca service nova] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:09:24.713234 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.compute.server_external_events [req-2190639c-3467-49d2-ac3c-7e4dca6958ea req-73504288-8228-4fbb-b590-503e5f09d3ca service nova] Creating event network-vif-plugged:40c60130-4312-40cf-8192-b2d69af35fa4 for instance 9a73fc48-03e5-457a-9ca7-a88320b99dea on hv-cinder-77642 Feb 19 05:09:24.724595 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [req-2190639c-3467-49d2-ac3c-7e4dca6958ea req-73504288-8228-4fbb-b590-503e5f09d3ca service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085320 Feb 19 05:09:24.725854 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 504/1004] 10.222.0.47 () {64 vars in 1308 bytes} [Fri Feb 19 05:09:24 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 05:09:25.117980 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-67784a07-3e16-44d1-a482-5220cbfd3de4 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:09:25.118750 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-67784a07-3e16-44d1-a482-5220cbfd3de4 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] [instance: 9a73fc48-03e5-457a-9ca7-a88320b99dea] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:09:25.128538 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-67784a07-3e16-44d1-a482-5220cbfd3de4 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:09:25.129054 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-67784a07-3e16-44d1-a482-5220cbfd3de4 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:09:25.129919 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-67784a07-3e16-44d1-a482-5220cbfd3de4 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:09:25.130412 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-67784a07-3e16-44d1-a482-5220cbfd3de4 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:09:25.353454 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-67784a07-3e16-44d1-a482-5220cbfd3de4 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32f894b7dad5447688fb395e08d31d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87857a2fc3a4866a8055ed181d12edf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:09:25.364703 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-67784a07-3e16-44d1-a482-5220cbfd3de4 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] 10.222.0.47 "GET /compute/v2.1/servers/9a73fc48-03e5-457a-9ca7-a88320b99dea" status: 200 len: 1273 microversion: 2.1 time: 0.251015 Feb 19 05:09:25.365345 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 501/1005] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:09:25 2021] GET /compute/v2.1/servers/9a73fc48-03e5-457a-9ca7-a88320b99dea => generated 1273 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:09:26.384145 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-e3a9460c-c297-4dc9-8085-1a4e1222f475 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:09:26.384959 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-e3a9460c-c297-4dc9-8085-1a4e1222f475 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] [instance: 9a73fc48-03e5-457a-9ca7-a88320b99dea] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:09:26.393732 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-e3a9460c-c297-4dc9-8085-1a4e1222f475 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:09:26.394236 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-e3a9460c-c297-4dc9-8085-1a4e1222f475 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:09:26.395070 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-e3a9460c-c297-4dc9-8085-1a4e1222f475 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:09:26.395582 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-e3a9460c-c297-4dc9-8085-1a4e1222f475 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:09:26.685861 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-e3a9460c-c297-4dc9-8085-1a4e1222f475 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32f894b7dad5447688fb395e08d31d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87857a2fc3a4866a8055ed181d12edf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:09:26.696494 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-e3a9460c-c297-4dc9-8085-1a4e1222f475 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] 10.222.0.47 "GET /compute/v2.1/servers/9a73fc48-03e5-457a-9ca7-a88320b99dea" status: 200 len: 1460 microversion: 2.1 time: 0.317061 Feb 19 05:09:26.697139 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 505/1006] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:09:26 2021] GET /compute/v2.1/servers/9a73fc48-03e5-457a-9ca7-a88320b99dea => generated 1460 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:09:26.716510 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-13ca7209-b2ab-4557-b85b-32d0116e56dc tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:09:26.717213 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-13ca7209-b2ab-4557-b85b-32d0116e56dc tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] [instance: 9a73fc48-03e5-457a-9ca7-a88320b99dea] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:09:26.725455 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-13ca7209-b2ab-4557-b85b-32d0116e56dc tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:09:26.725973 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-13ca7209-b2ab-4557-b85b-32d0116e56dc tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:09:26.726831 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-13ca7209-b2ab-4557-b85b-32d0116e56dc tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:09:26.727397 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-13ca7209-b2ab-4557-b85b-32d0116e56dc tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:09:27.365190 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-13ca7209-b2ab-4557-b85b-32d0116e56dc tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32f894b7dad5447688fb395e08d31d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87857a2fc3a4866a8055ed181d12edf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:09:27.378796 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-13ca7209-b2ab-4557-b85b-32d0116e56dc tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] 10.222.0.47 "GET /compute/v2.1/servers/9a73fc48-03e5-457a-9ca7-a88320b99dea" status: 200 len: 1460 microversion: 2.1 time: 0.666911 Feb 19 05:09:27.379208 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 502/1007] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:09:26 2021] GET /compute/v2.1/servers/9a73fc48-03e5-457a-9ca7-a88320b99dea => generated 1460 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:09:27.398242 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-00fe862a-16c5-4245-ad48-d78736ba5fdd tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Action: 'create', calling method: .version_select at 0x7f270723bbf8>, body: {"pool": null} {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:09:29.767504 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-00fe862a-16c5-4245-ad48-d78736ba5fdd tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] 10.222.0.47 "POST /compute/v2.1/os-floating-ips" status: 200 len: 140 microversion: 2.1 time: 2.373216 Feb 19 05:09:29.768178 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 506/1008] 10.222.0.47 () {60 vars in 1160 bytes} [Fri Feb 19 05:09:27 2021] POST /compute/v2.1/os-floating-ips => generated 140 bytes in 2375 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 05:09:29.781166 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-e5d5f323-4440-42fd-b999-d6663a685718 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.27.0.5"}} {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:09:29.782503 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-e5d5f323-4440-42fd-b999-d6663a685718 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] [instance: 9a73fc48-03e5-457a-9ca7-a88320b99dea] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:09:29.790467 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-e5d5f323-4440-42fd-b999-d6663a685718 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:09:29.790976 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-e5d5f323-4440-42fd-b999-d6663a685718 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:09:29.791878 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-e5d5f323-4440-42fd-b999-d6663a685718 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:09:29.792374 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-e5d5f323-4440-42fd-b999-d6663a685718 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:09:29.865538 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-e5d5f323-4440-42fd-b999-d6663a685718 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Acquired lock "refresh_cache-9a73fc48-03e5-457a-9ca7-a88320b99dea" {{(pid=98153) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:266}} Feb 19 05:09:31.880077 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.network.neutron [None req-e5d5f323-4440-42fd-b999-d6663a685718 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] [instance: 9a73fc48-03e5-457a-9ca7-a88320b99dea] Building network info cache for instance {{(pid=98153) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1836}} Feb 19 05:09:31.890613 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [req-ba745205-fb84-43e7-af17-ccb7192c2d8c req-d136a1ef-91cb-47a7-a0e0-bfb4af4fccea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9a73fc48-03e5-457a-9ca7-a88320b99dea", "tag": "40c60130-4312-40cf-8192-b2d69af35fa4"}]} {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:09:31.892374 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 05:09:31.892374 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: warnings.warn(msg) Feb 19 05:09:31.901363 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [req-ba745205-fb84-43e7-af17-ccb7192c2d8c req-d136a1ef-91cb-47a7-a0e0-bfb4af4fccea service nova] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:09:31.902542 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [req-ba745205-fb84-43e7-af17-ccb7192c2d8c req-d136a1ef-91cb-47a7-a0e0-bfb4af4fccea service nova] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:09:31.923541 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.compute.server_external_events [req-ba745205-fb84-43e7-af17-ccb7192c2d8c req-d136a1ef-91cb-47a7-a0e0-bfb4af4fccea service nova] Creating event network-changed:40c60130-4312-40cf-8192-b2d69af35fa4 for instance 9a73fc48-03e5-457a-9ca7-a88320b99dea on hv-cinder-77642 Feb 19 05:09:31.929823 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [req-ba745205-fb84-43e7-af17-ccb7192c2d8c req-d136a1ef-91cb-47a7-a0e0-bfb4af4fccea service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044317 Feb 19 05:09:31.930949 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 507/1009] 10.222.0.47 () {64 vars in 1308 bytes} [Fri Feb 19 05:09:31 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 19 05:09:33.497141 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.network.neutron [None req-e5d5f323-4440-42fd-b999-d6663a685718 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] [instance: 9a73fc48-03e5-457a-9ca7-a88320b99dea] Updating instance_info_cache with network_info: [{"id": "40c60130-4312-40cf-8192-b2d69af35fa4", "address": "fa:16:3e:9f:22:86", "network": {"id": "68c8736e-693c-40d6-962b-ec56c71786c4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-815410707-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.27.0.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "f87857a2fc3a4866a8055ed181d12edf", "mtu": 1450, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, "devname": "tap40c60130-43", "ovs_interfaceid": "40c60130-4312-40cf-8192-b2d69af35fa4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "meta": {}}] {{(pid=98153) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Feb 19 05:09:33.508014 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-e5d5f323-4440-42fd-b999-d6663a685718 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Releasing lock "refresh_cache-9a73fc48-03e5-457a-9ca7-a88320b99dea" {{(pid=98153) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:282}} Feb 19 05:09:33.508955 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-e5d5f323-4440-42fd-b999-d6663a685718 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] 10.222.0.47 "POST /compute/v2.1/servers/9a73fc48-03e5-457a-9ca7-a88320b99dea/action" status: 202 len: 0 microversion: 2.1 time: 3.733034 Feb 19 05:09:33.509623 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 503/1010] 10.222.0.47 () {60 vars in 1268 bytes} [Fri Feb 19 05:09:29 2021] POST /compute/v2.1/servers/9a73fc48-03e5-457a-9ca7-a88320b99dea/action => generated 0 bytes in 3734 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Feb 19 05:09:35.467797 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 19 05:09:35.468386 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: Fri Feb 19 05:09:35 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 19 05:10:08.453656 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-e0b209f4-d5b1-496c-a199-e23e2665ecd0 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Action: 'create', calling method: .version_select at 0x7f27067a3b70>, body: {"keypair": {"name": "tempest-TestShelveInstance-1039927372"}} {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:10:08.478742 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.quota [None req-e0b209f4-d5b1-496c-a199-e23e2665ecd0 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Getting quotas for project 95e9a5a891aa4f9184d68b7730fe8805. Resources: {'key_pairs'} {{(pid=98154) _get_quotas /opt/stack/nova/nova/quota.py:388}} Feb 19 05:10:08.484080 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.quota [None req-e0b209f4-d5b1-496c-a199-e23e2665ecd0 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Getting quotas for user 878e94e8d400454790f54697f9a8f9e2 and project 95e9a5a891aa4f9184d68b7730fe8805. Resources: {'key_pairs'} {{(pid=98154) _get_quotas /opt/stack/nova/nova/quota.py:380}} Feb 19 05:10:08.725085 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.quota [None req-e0b209f4-d5b1-496c-a199-e23e2665ecd0 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Getting quotas for project 95e9a5a891aa4f9184d68b7730fe8805. Resources: {'key_pairs'} {{(pid=98154) _get_quotas /opt/stack/nova/nova/quota.py:388}} Feb 19 05:10:08.729240 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.quota [None req-e0b209f4-d5b1-496c-a199-e23e2665ecd0 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Getting quotas for user 878e94e8d400454790f54697f9a8f9e2 and project 95e9a5a891aa4f9184d68b7730fe8805. Resources: {'key_pairs'} {{(pid=98154) _get_quotas /opt/stack/nova/nova/quota.py:380}} Feb 19 05:10:08.742952 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-e0b209f4-d5b1-496c-a199-e23e2665ecd0 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 2316 microversion: 2.1 time: 0.487378 Feb 19 05:10:08.743653 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 508/1011] 10.222.0.47 () {60 vars in 1148 bytes} [Fri Feb 19 05:10:08 2021] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:10:08.754804 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-250b3e7a-daf2-490e-9dea-a54c455c0d9d tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Action: 'create', calling method: .version_select at 0x7f27067ca950>, body: {"security_group": {"name": "tempest-TestShelveInstance-560875746", "description": "tempest-TestShelveInstance-560875746 description"}} {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:10:08.974086 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-250b3e7a-daf2-490e-9dea-a54c455c0d9d tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] 10.222.0.47 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.223498 Feb 19 05:10:08.975016 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 504/1012] 10.222.0.47 () {60 vars in 1170 bytes} [Fri Feb 19 05:10:08 2021] POST /compute/v2.1/os-security-groups => generated 243 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 05:10:08.987206 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-ee93d0d9-c572-47d4-acb5-53892bd889f8 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Action: 'create', calling method: .version_select at 0x7f270723b730>, body: {"security_group_rule": {"parent_group_id": "9897a4e1-e93b-43f8-8404-7e98cf7b0511", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "cidr": "0.0.0.0/0"}} {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:10:09.208255 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-ee93d0d9-c572-47d4-acb5-53892bd889f8 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] 10.222.0.47 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.225167 Feb 19 05:10:09.208921 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 509/1013] 10.222.0.47 () {60 vars in 1185 bytes} [Fri Feb 19 05:10:08 2021] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 05:10:09.220224 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-817c5241-4091-4a81-be79-f0e6832122f0 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Action: 'create', calling method: .version_select at 0x7f27067cad08>, body: {"security_group_rule": {"parent_group_id": "9897a4e1-e93b-43f8-8404-7e98cf7b0511", "ip_protocol": "icmp", "from_port": -1, "to_port": -1, "cidr": "0.0.0.0/0"}} {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:10:09.444799 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-817c5241-4091-4a81-be79-f0e6832122f0 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] 10.222.0.47 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 233 microversion: 2.1 time: 0.228520 Feb 19 05:10:09.445465 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 505/1014] 10.222.0.47 () {60 vars in 1185 bytes} [Fri Feb 19 05:10:09 2021] POST /compute/v2.1/os-security-group-rules => generated 233 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 05:10:26.821808 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-f656fed8-1765-4e10-a301-1c3f258fce35 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-190814825", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1039927372", "security_groups": [{"name": "tempest-TestShelveInstance-560875746"}], "networks": [{"uuid": "6e82c627-b5d1-4c59-bf38-23c61d54a5a6"}], "block_device_mapping_v2": [{"uuid": "e63b49c7-9b22-4c49-a10d-81e5b549f6ec", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:10:27.013891 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.network.neutron [None req-f656fed8-1765-4e10-a301-1c3f258fce35 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] validate_networks() for [('6e82c627-b5d1-4c59-bf38-23c61d54a5a6', None, None, None)] {{(pid=98154) validate_networks /opt/stack/nova/nova/network/neutron.py:2345}} Feb 19 05:10:27.753763 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.virt.hardware [None req-f656fed8-1765-4e10-a301-1c3f258fce35 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Flavor limits 0:0:0 {{(pid=98154) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 19 05:10:27.754241 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.virt.hardware [None req-f656fed8-1765-4e10-a301-1c3f258fce35 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Image limits 0:0:0 {{(pid=98154) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Feb 19 05:10:27.754788 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.virt.hardware [None req-f656fed8-1765-4e10-a301-1c3f258fce35 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Flavor pref 0:0:0 {{(pid=98154) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 19 05:10:27.755298 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.virt.hardware [None req-f656fed8-1765-4e10-a301-1c3f258fce35 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Image pref 0:0:0 {{(pid=98154) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Feb 19 05:10:27.755786 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.virt.hardware [None req-f656fed8-1765-4e10-a301-1c3f258fce35 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98154) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Feb 19 05:10:27.765527 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-f656fed8-1765-4e10-a301-1c3f258fce35 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:10:27.766036 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-f656fed8-1765-4e10-a301-1c3f258fce35 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:10:27.766913 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-f656fed8-1765-4e10-a301-1c3f258fce35 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:10:27.767431 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-f656fed8-1765-4e10-a301-1c3f258fce35 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:10:27.786640 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.quota [None req-f656fed8-1765-4e10-a301-1c3f258fce35 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Getting quotas for project 95e9a5a891aa4f9184d68b7730fe8805. Resources: {'instances', 'ram', 'cores'} {{(pid=98154) _get_quotas /opt/stack/nova/nova/quota.py:388}} Feb 19 05:10:27.790940 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.quota [None req-f656fed8-1765-4e10-a301-1c3f258fce35 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Getting quotas for user 878e94e8d400454790f54697f9a8f9e2 and project 95e9a5a891aa4f9184d68b7730fe8805. Resources: {'instances', 'ram', 'cores'} {{(pid=98154) _get_quotas /opt/stack/nova/nova/quota.py:380}} Feb 19 05:10:27.900054 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-f656fed8-1765-4e10-a301-1c3f258fce35 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Going to run 1 instances... {{(pid=98154) _provision_instances /opt/stack/nova/nova/compute/api.py:1264}} Feb 19 05:10:27.903133 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-f656fed8-1765-4e10-a301-1c3f258fce35 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] [instance: 66b6840a-cca9-43d0-824e-2d492eb10b1d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e63b49c7-9b22-4c49-a10d-81e5b549f6ec',volume_size=None,volume_type=None)] {{(pid=98154) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1666}} Feb 19 05:10:28.087532 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-f656fed8-1765-4e10-a301-1c3f258fce35 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.269932 Feb 19 05:10:28.088253 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 510/1015] 10.222.0.47 () {60 vars in 1137 bytes} [Fri Feb 19 05:10:26 2021] POST /compute/v2.1/servers => generated 409 bytes in 1271 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 19 05:10:28.099697 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-7f4cc3a3-f100-4ee3-a3a5-7dd776efe542 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:10:28.100775 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-7f4cc3a3-f100-4ee3-a3a5-7dd776efe542 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] [instance: 66b6840a-cca9-43d0-824e-2d492eb10b1d] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:10:28.182460 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-7f4cc3a3-f100-4ee3-a3a5-7dd776efe542 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '878e94e8d400454790f54697f9a8f9e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e9a5a891aa4f9184d68b7730fe8805', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:10:28.191864 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-7f4cc3a3-f100-4ee3-a3a5-7dd776efe542 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] 10.222.0.47 "GET /compute/v2.1/servers/66b6840a-cca9-43d0-824e-2d492eb10b1d" status: 200 len: 1088 microversion: 2.1 time: 0.096255 Feb 19 05:10:28.192499 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 506/1016] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:10:28 2021] GET /compute/v2.1/servers/66b6840a-cca9-43d0-824e-2d492eb10b1d => generated 1088 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:10:29.210259 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-605b883d-8026-44b4-a3e7-1437cb6878ec tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:10:29.210944 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-605b883d-8026-44b4-a3e7-1437cb6878ec tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] [instance: 66b6840a-cca9-43d0-824e-2d492eb10b1d] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:10:29.221323 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-605b883d-8026-44b4-a3e7-1437cb6878ec tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:10:29.221877 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-605b883d-8026-44b4-a3e7-1437cb6878ec tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:10:29.222768 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-605b883d-8026-44b4-a3e7-1437cb6878ec tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:10:29.223353 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-605b883d-8026-44b4-a3e7-1437cb6878ec tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:10:29.370868 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-605b883d-8026-44b4-a3e7-1437cb6878ec tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '878e94e8d400454790f54697f9a8f9e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e9a5a891aa4f9184d68b7730fe8805', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:10:29.384896 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-605b883d-8026-44b4-a3e7-1437cb6878ec tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] 10.222.0.47 "GET /compute/v2.1/servers/66b6840a-cca9-43d0-824e-2d492eb10b1d" status: 200 len: 1186 microversion: 2.1 time: 0.178647 Feb 19 05:10:29.385749 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 511/1017] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:10:29 2021] GET /compute/v2.1/servers/66b6840a-cca9-43d0-824e-2d492eb10b1d => generated 1186 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:10:30.404634 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-26c05a6c-e3b2-40b2-9422-45acbba8cb81 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:10:30.405603 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-26c05a6c-e3b2-40b2-9422-45acbba8cb81 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] [instance: 66b6840a-cca9-43d0-824e-2d492eb10b1d] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:10:30.414275 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-26c05a6c-e3b2-40b2-9422-45acbba8cb81 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:10:30.414938 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-26c05a6c-e3b2-40b2-9422-45acbba8cb81 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:10:30.415924 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-26c05a6c-e3b2-40b2-9422-45acbba8cb81 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:10:30.416438 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-26c05a6c-e3b2-40b2-9422-45acbba8cb81 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:10:30.643919 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-26c05a6c-e3b2-40b2-9422-45acbba8cb81 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '878e94e8d400454790f54697f9a8f9e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e9a5a891aa4f9184d68b7730fe8805', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:10:30.653237 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-26c05a6c-e3b2-40b2-9422-45acbba8cb81 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] 10.222.0.47 "GET /compute/v2.1/servers/66b6840a-cca9-43d0-824e-2d492eb10b1d" status: 200 len: 1275 microversion: 2.1 time: 0.252995 Feb 19 05:10:30.653885 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 507/1018] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:10:30 2021] GET /compute/v2.1/servers/66b6840a-cca9-43d0-824e-2d492eb10b1d => generated 1275 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:10:31.672478 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-cd3e2059-135f-46ab-ae31-9e91fb643ca1 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:10:31.673175 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-cd3e2059-135f-46ab-ae31-9e91fb643ca1 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] [instance: 66b6840a-cca9-43d0-824e-2d492eb10b1d] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:10:31.681818 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-cd3e2059-135f-46ab-ae31-9e91fb643ca1 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:10:31.682616 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-cd3e2059-135f-46ab-ae31-9e91fb643ca1 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:10:31.683517 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-cd3e2059-135f-46ab-ae31-9e91fb643ca1 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:10:31.684873 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-cd3e2059-135f-46ab-ae31-9e91fb643ca1 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:10:31.900888 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-cd3e2059-135f-46ab-ae31-9e91fb643ca1 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '878e94e8d400454790f54697f9a8f9e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e9a5a891aa4f9184d68b7730fe8805', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:10:31.910989 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-cd3e2059-135f-46ab-ae31-9e91fb643ca1 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] 10.222.0.47 "GET /compute/v2.1/servers/66b6840a-cca9-43d0-824e-2d492eb10b1d" status: 200 len: 1263 microversion: 2.1 time: 0.243362 Feb 19 05:10:31.911674 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 512/1019] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:10:31 2021] GET /compute/v2.1/servers/66b6840a-cca9-43d0-824e-2d492eb10b1d => generated 1263 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:10:32.197514 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [req-72706e9b-687d-4f40-93a9-8aeddf9ecadd req-95369140-1fb0-44aa-8388-90304ced646e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "66b6840a-cca9-43d0-824e-2d492eb10b1d", "tag": "335386b1-d194-45cc-bccd-e8dfb53329a0"}]} {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:10:32.200240 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 05:10:32.200240 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: warnings.warn(msg) Feb 19 05:10:32.210087 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [req-72706e9b-687d-4f40-93a9-8aeddf9ecadd req-95369140-1fb0-44aa-8388-90304ced646e service nova] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:10:32.210583 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [req-72706e9b-687d-4f40-93a9-8aeddf9ecadd req-95369140-1fb0-44aa-8388-90304ced646e service nova] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:10:32.230051 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.compute.server_external_events [req-72706e9b-687d-4f40-93a9-8aeddf9ecadd req-95369140-1fb0-44aa-8388-90304ced646e service nova] Creating event network-changed:335386b1-d194-45cc-bccd-e8dfb53329a0 for instance 66b6840a-cca9-43d0-824e-2d492eb10b1d on hv-cinder-77642 Feb 19 05:10:32.235260 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [req-72706e9b-687d-4f40-93a9-8aeddf9ecadd req-95369140-1fb0-44aa-8388-90304ced646e service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110420 Feb 19 05:10:32.236141 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 508/1020] 10.222.0.47 () {64 vars in 1308 bytes} [Fri Feb 19 05:10:32 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 05:10:32.930308 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-39a166af-882b-4250-9308-7e0d56778ac1 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:10:32.932230 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-39a166af-882b-4250-9308-7e0d56778ac1 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] [instance: 66b6840a-cca9-43d0-824e-2d492eb10b1d] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:10:32.940821 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-39a166af-882b-4250-9308-7e0d56778ac1 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:10:32.941852 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-39a166af-882b-4250-9308-7e0d56778ac1 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:10:32.942723 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-39a166af-882b-4250-9308-7e0d56778ac1 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:10:32.943219 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-39a166af-882b-4250-9308-7e0d56778ac1 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:10:33.167525 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-39a166af-882b-4250-9308-7e0d56778ac1 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '878e94e8d400454790f54697f9a8f9e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e9a5a891aa4f9184d68b7730fe8805', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:10:33.177344 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-39a166af-882b-4250-9308-7e0d56778ac1 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] 10.222.0.47 "GET /compute/v2.1/servers/66b6840a-cca9-43d0-824e-2d492eb10b1d" status: 200 len: 1263 microversion: 2.1 time: 0.251176 Feb 19 05:10:33.177978 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 513/1021] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:10:32 2021] GET /compute/v2.1/servers/66b6840a-cca9-43d0-824e-2d492eb10b1d => generated 1263 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:10:34.197449 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-2585528b-8d03-4d4f-a7e9-cc3acd3f362d tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:10:34.198133 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-2585528b-8d03-4d4f-a7e9-cc3acd3f362d tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] [instance: 66b6840a-cca9-43d0-824e-2d492eb10b1d] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:10:34.207055 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-2585528b-8d03-4d4f-a7e9-cc3acd3f362d tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:10:34.207586 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-2585528b-8d03-4d4f-a7e9-cc3acd3f362d tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:10:34.208421 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-2585528b-8d03-4d4f-a7e9-cc3acd3f362d tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:10:34.208907 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-2585528b-8d03-4d4f-a7e9-cc3acd3f362d tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:10:34.422493 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-2585528b-8d03-4d4f-a7e9-cc3acd3f362d tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '878e94e8d400454790f54697f9a8f9e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e9a5a891aa4f9184d68b7730fe8805', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:10:34.431315 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-2585528b-8d03-4d4f-a7e9-cc3acd3f362d tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] 10.222.0.47 "GET /compute/v2.1/servers/66b6840a-cca9-43d0-824e-2d492eb10b1d" status: 200 len: 1263 microversion: 2.1 time: 0.238489 Feb 19 05:10:34.431962 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 509/1022] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:10:34 2021] GET /compute/v2.1/servers/66b6840a-cca9-43d0-824e-2d492eb10b1d => generated 1263 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:10:35.451949 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-90697134-d19e-4694-b311-acedf2c7c46c tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:10:35.452629 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-90697134-d19e-4694-b311-acedf2c7c46c tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] [instance: 66b6840a-cca9-43d0-824e-2d492eb10b1d] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:10:35.460826 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-90697134-d19e-4694-b311-acedf2c7c46c tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:10:35.461337 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-90697134-d19e-4694-b311-acedf2c7c46c tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:10:35.462193 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-90697134-d19e-4694-b311-acedf2c7c46c tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:10:35.462685 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-90697134-d19e-4694-b311-acedf2c7c46c tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:10:35.688402 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-90697134-d19e-4694-b311-acedf2c7c46c tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '878e94e8d400454790f54697f9a8f9e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e9a5a891aa4f9184d68b7730fe8805', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:10:35.697231 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-90697134-d19e-4694-b311-acedf2c7c46c tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] 10.222.0.47 "GET /compute/v2.1/servers/66b6840a-cca9-43d0-824e-2d492eb10b1d" status: 200 len: 1263 microversion: 2.1 time: 0.250728 Feb 19 05:10:35.697862 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 514/1023] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:10:35 2021] GET /compute/v2.1/servers/66b6840a-cca9-43d0-824e-2d492eb10b1d => generated 1263 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:10:36.716423 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-40e6ea58-6111-4745-a23b-165ab6dc1c14 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:10:36.717084 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-40e6ea58-6111-4745-a23b-165ab6dc1c14 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] [instance: 66b6840a-cca9-43d0-824e-2d492eb10b1d] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:10:36.724923 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-40e6ea58-6111-4745-a23b-165ab6dc1c14 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:10:36.725423 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-40e6ea58-6111-4745-a23b-165ab6dc1c14 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:10:36.726248 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-40e6ea58-6111-4745-a23b-165ab6dc1c14 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:10:36.726774 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-40e6ea58-6111-4745-a23b-165ab6dc1c14 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:10:36.941290 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-40e6ea58-6111-4745-a23b-165ab6dc1c14 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '878e94e8d400454790f54697f9a8f9e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e9a5a891aa4f9184d68b7730fe8805', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:10:36.951128 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-40e6ea58-6111-4745-a23b-165ab6dc1c14 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] 10.222.0.47 "GET /compute/v2.1/servers/66b6840a-cca9-43d0-824e-2d492eb10b1d" status: 200 len: 1263 microversion: 2.1 time: 0.238885 Feb 19 05:10:36.951791 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 510/1024] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:10:36 2021] GET /compute/v2.1/servers/66b6840a-cca9-43d0-824e-2d492eb10b1d => generated 1263 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:10:37.969818 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-4d7bed16-8124-4ec9-9fca-721bcdc23c7f tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:10:37.970493 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-4d7bed16-8124-4ec9-9fca-721bcdc23c7f tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] [instance: 66b6840a-cca9-43d0-824e-2d492eb10b1d] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:10:37.978482 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-4d7bed16-8124-4ec9-9fca-721bcdc23c7f tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:10:37.978996 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-4d7bed16-8124-4ec9-9fca-721bcdc23c7f tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:10:37.979864 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-4d7bed16-8124-4ec9-9fca-721bcdc23c7f tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:10:37.980361 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-4d7bed16-8124-4ec9-9fca-721bcdc23c7f tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:10:38.193871 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-4d7bed16-8124-4ec9-9fca-721bcdc23c7f tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '878e94e8d400454790f54697f9a8f9e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e9a5a891aa4f9184d68b7730fe8805', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:10:38.203753 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-4d7bed16-8124-4ec9-9fca-721bcdc23c7f tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] 10.222.0.47 "GET /compute/v2.1/servers/66b6840a-cca9-43d0-824e-2d492eb10b1d" status: 200 len: 1263 microversion: 2.1 time: 0.238497 Feb 19 05:10:38.204429 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 515/1025] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:10:37 2021] GET /compute/v2.1/servers/66b6840a-cca9-43d0-824e-2d492eb10b1d => generated 1263 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:10:39.222642 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-532f2b74-c5e8-461d-8198-977a39fb2d0c tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:10:39.223320 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-532f2b74-c5e8-461d-8198-977a39fb2d0c tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] [instance: 66b6840a-cca9-43d0-824e-2d492eb10b1d] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:10:39.232346 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-532f2b74-c5e8-461d-8198-977a39fb2d0c tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:10:39.232806 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-532f2b74-c5e8-461d-8198-977a39fb2d0c tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:10:39.233661 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-532f2b74-c5e8-461d-8198-977a39fb2d0c tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:10:39.234164 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-532f2b74-c5e8-461d-8198-977a39fb2d0c tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:10:39.448356 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-532f2b74-c5e8-461d-8198-977a39fb2d0c tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '878e94e8d400454790f54697f9a8f9e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e9a5a891aa4f9184d68b7730fe8805', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:10:39.457462 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-532f2b74-c5e8-461d-8198-977a39fb2d0c tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] 10.222.0.47 "GET /compute/v2.1/servers/66b6840a-cca9-43d0-824e-2d492eb10b1d" status: 200 len: 1263 microversion: 2.1 time: 0.238945 Feb 19 05:10:39.458099 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 511/1026] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:10:39 2021] GET /compute/v2.1/servers/66b6840a-cca9-43d0-824e-2d492eb10b1d => generated 1263 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:10:40.476960 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-fc43ccf1-bee6-4e06-8843-615c869189cb tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:10:40.477637 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-fc43ccf1-bee6-4e06-8843-615c869189cb tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] [instance: 66b6840a-cca9-43d0-824e-2d492eb10b1d] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:10:40.486161 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-fc43ccf1-bee6-4e06-8843-615c869189cb tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:10:40.486676 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-fc43ccf1-bee6-4e06-8843-615c869189cb tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:10:40.487546 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-fc43ccf1-bee6-4e06-8843-615c869189cb tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:10:40.488039 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-fc43ccf1-bee6-4e06-8843-615c869189cb tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:10:40.703155 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-fc43ccf1-bee6-4e06-8843-615c869189cb tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '878e94e8d400454790f54697f9a8f9e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e9a5a891aa4f9184d68b7730fe8805', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:10:40.712095 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-fc43ccf1-bee6-4e06-8843-615c869189cb tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] 10.222.0.47 "GET /compute/v2.1/servers/66b6840a-cca9-43d0-824e-2d492eb10b1d" status: 200 len: 1263 microversion: 2.1 time: 0.239299 Feb 19 05:10:40.712718 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 516/1027] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:10:40 2021] GET /compute/v2.1/servers/66b6840a-cca9-43d0-824e-2d492eb10b1d => generated 1263 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:10:41.730259 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-7176a165-25ae-46e8-8ba1-0029ac6e02d1 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:10:41.730983 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-7176a165-25ae-46e8-8ba1-0029ac6e02d1 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] [instance: 66b6840a-cca9-43d0-824e-2d492eb10b1d] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:10:41.739535 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-7176a165-25ae-46e8-8ba1-0029ac6e02d1 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:10:41.740117 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-7176a165-25ae-46e8-8ba1-0029ac6e02d1 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:10:41.740876 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-7176a165-25ae-46e8-8ba1-0029ac6e02d1 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:10:41.741372 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-7176a165-25ae-46e8-8ba1-0029ac6e02d1 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:10:41.751926 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [req-d226c23a-7292-4a99-bfff-61181f25271d req-4da61390-4ac7-4005-a2b6-e8ed1dd6bb08 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66b6840a-cca9-43d0-824e-2d492eb10b1d", "name": "network-vif-plugged", "status": "completed", "tag": "335386b1-d194-45cc-bccd-e8dfb53329a0"}]} {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:10:41.754456 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 05:10:41.754456 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: warnings.warn(msg) Feb 19 05:10:41.765269 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [req-d226c23a-7292-4a99-bfff-61181f25271d req-4da61390-4ac7-4005-a2b6-e8ed1dd6bb08 service nova] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:10:41.765770 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [req-d226c23a-7292-4a99-bfff-61181f25271d req-4da61390-4ac7-4005-a2b6-e8ed1dd6bb08 service nova] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:10:41.784218 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.compute.server_external_events [req-d226c23a-7292-4a99-bfff-61181f25271d req-4da61390-4ac7-4005-a2b6-e8ed1dd6bb08 service nova] Creating event network-vif-plugged:335386b1-d194-45cc-bccd-e8dfb53329a0 for instance 66b6840a-cca9-43d0-824e-2d492eb10b1d on hv-cinder-77642 Feb 19 05:10:41.789551 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [req-d226c23a-7292-4a99-bfff-61181f25271d req-4da61390-4ac7-4005-a2b6-e8ed1dd6bb08 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041897 Feb 19 05:10:41.790370 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 517/1028] 10.222.0.47 () {64 vars in 1308 bytes} [Fri Feb 19 05:10:41 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 19 05:10:41.963953 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-7176a165-25ae-46e8-8ba1-0029ac6e02d1 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '878e94e8d400454790f54697f9a8f9e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e9a5a891aa4f9184d68b7730fe8805', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:10:41.974233 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-7176a165-25ae-46e8-8ba1-0029ac6e02d1 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] 10.222.0.47 "GET /compute/v2.1/servers/66b6840a-cca9-43d0-824e-2d492eb10b1d" status: 200 len: 1263 microversion: 2.1 time: 0.248033 Feb 19 05:10:41.975086 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 512/1029] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:10:41 2021] GET /compute/v2.1/servers/66b6840a-cca9-43d0-824e-2d492eb10b1d => generated 1263 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:10:42.992930 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-63edfcc7-fdc5-4a6c-803a-e064ba89d6b8 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:10:42.993696 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-63edfcc7-fdc5-4a6c-803a-e064ba89d6b8 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] [instance: 66b6840a-cca9-43d0-824e-2d492eb10b1d] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:10:43.002059 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-63edfcc7-fdc5-4a6c-803a-e064ba89d6b8 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:10:43.002561 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-63edfcc7-fdc5-4a6c-803a-e064ba89d6b8 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:10:43.003400 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-63edfcc7-fdc5-4a6c-803a-e064ba89d6b8 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:10:43.003890 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-63edfcc7-fdc5-4a6c-803a-e064ba89d6b8 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:10:43.224668 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-63edfcc7-fdc5-4a6c-803a-e064ba89d6b8 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '878e94e8d400454790f54697f9a8f9e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e9a5a891aa4f9184d68b7730fe8805', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:10:43.235306 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-63edfcc7-fdc5-4a6c-803a-e064ba89d6b8 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] 10.222.0.47 "GET /compute/v2.1/servers/66b6840a-cca9-43d0-824e-2d492eb10b1d" status: 200 len: 1263 microversion: 2.1 time: 0.246849 Feb 19 05:10:43.236042 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 518/1030] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:10:42 2021] GET /compute/v2.1/servers/66b6840a-cca9-43d0-824e-2d492eb10b1d => generated 1263 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:10:44.254162 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-610f79e8-f87d-488e-a09f-44aab144f85d tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:10:44.254746 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-610f79e8-f87d-488e-a09f-44aab144f85d tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] [instance: 66b6840a-cca9-43d0-824e-2d492eb10b1d] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:10:44.262781 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-610f79e8-f87d-488e-a09f-44aab144f85d tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:10:44.263584 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-610f79e8-f87d-488e-a09f-44aab144f85d tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:10:44.264410 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-610f79e8-f87d-488e-a09f-44aab144f85d tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:10:44.264895 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-610f79e8-f87d-488e-a09f-44aab144f85d tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:10:44.480331 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-610f79e8-f87d-488e-a09f-44aab144f85d tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '878e94e8d400454790f54697f9a8f9e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e9a5a891aa4f9184d68b7730fe8805', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:10:44.489931 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-610f79e8-f87d-488e-a09f-44aab144f85d tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] 10.222.0.47 "GET /compute/v2.1/servers/66b6840a-cca9-43d0-824e-2d492eb10b1d" status: 200 len: 1445 microversion: 2.1 time: 0.239885 Feb 19 05:10:44.490568 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 513/1031] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:10:44 2021] GET /compute/v2.1/servers/66b6840a-cca9-43d0-824e-2d492eb10b1d => generated 1445 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:10:44.507898 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-b29513cc-1117-46ee-886d-bc9c5aec3c3e tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:10:44.508508 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-b29513cc-1117-46ee-886d-bc9c5aec3c3e tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] [instance: 66b6840a-cca9-43d0-824e-2d492eb10b1d] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:10:44.516934 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-b29513cc-1117-46ee-886d-bc9c5aec3c3e tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:10:44.517445 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-b29513cc-1117-46ee-886d-bc9c5aec3c3e tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:10:44.518267 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-b29513cc-1117-46ee-886d-bc9c5aec3c3e tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:10:44.518756 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-b29513cc-1117-46ee-886d-bc9c5aec3c3e tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:10:44.735100 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-b29513cc-1117-46ee-886d-bc9c5aec3c3e tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '878e94e8d400454790f54697f9a8f9e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e9a5a891aa4f9184d68b7730fe8805', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:10:44.744151 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-b29513cc-1117-46ee-886d-bc9c5aec3c3e tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] 10.222.0.47 "GET /compute/v2.1/servers/66b6840a-cca9-43d0-824e-2d492eb10b1d" status: 200 len: 1445 microversion: 2.1 time: 0.240568 Feb 19 05:10:44.744776 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 519/1032] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:10:44 2021] GET /compute/v2.1/servers/66b6840a-cca9-43d0-824e-2d492eb10b1d => generated 1445 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:10:44.761264 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-c4b2bc35-36e1-431b-b351-d8780db0e17c tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Action: 'create', calling method: .version_select at 0x7f27067ca378>, body: {"pool": null} {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:10:47.037374 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-c4b2bc35-36e1-431b-b351-d8780db0e17c tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] 10.222.0.47 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 2.280040 Feb 19 05:10:47.038031 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 514/1033] 10.222.0.47 () {60 vars in 1160 bytes} [Fri Feb 19 05:10:44 2021] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 2281 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 05:10:47.050814 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-555cd532-bb46-4ac9-b9c0-1c901c0d81d7 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.27.0.85"}} {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:10:47.052093 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-555cd532-bb46-4ac9-b9c0-1c901c0d81d7 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] [instance: 66b6840a-cca9-43d0-824e-2d492eb10b1d] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:10:47.060727 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-555cd532-bb46-4ac9-b9c0-1c901c0d81d7 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:10:47.061239 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-555cd532-bb46-4ac9-b9c0-1c901c0d81d7 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:10:47.062081 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-555cd532-bb46-4ac9-b9c0-1c901c0d81d7 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:10:47.062622 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-555cd532-bb46-4ac9-b9c0-1c901c0d81d7 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:10:47.127266 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-555cd532-bb46-4ac9-b9c0-1c901c0d81d7 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Acquired lock "refresh_cache-66b6840a-cca9-43d0-824e-2d492eb10b1d" {{(pid=98154) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:266}} Feb 19 05:10:49.126222 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.network.neutron [None req-555cd532-bb46-4ac9-b9c0-1c901c0d81d7 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] [instance: 66b6840a-cca9-43d0-824e-2d492eb10b1d] Building network info cache for instance {{(pid=98154) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1836}} Feb 19 05:10:49.201712 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [req-8daec78c-603f-4420-95e3-e005adab06f1 req-65f0db5c-2da0-4919-a261-d42fc842e867 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "66b6840a-cca9-43d0-824e-2d492eb10b1d", "tag": "335386b1-d194-45cc-bccd-e8dfb53329a0"}]} {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:10:49.203635 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 05:10:49.203635 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: warnings.warn(msg) Feb 19 05:10:49.213535 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [req-8daec78c-603f-4420-95e3-e005adab06f1 req-65f0db5c-2da0-4919-a261-d42fc842e867 service nova] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:10:49.214034 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [req-8daec78c-603f-4420-95e3-e005adab06f1 req-65f0db5c-2da0-4919-a261-d42fc842e867 service nova] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:10:49.234433 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.compute.server_external_events [req-8daec78c-603f-4420-95e3-e005adab06f1 req-65f0db5c-2da0-4919-a261-d42fc842e867 service nova] Creating event network-changed:335386b1-d194-45cc-bccd-e8dfb53329a0 for instance 66b6840a-cca9-43d0-824e-2d492eb10b1d on hv-cinder-77642 Feb 19 05:10:49.240138 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [req-8daec78c-603f-4420-95e3-e005adab06f1 req-65f0db5c-2da0-4919-a261-d42fc842e867 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109167 Feb 19 05:10:49.241075 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 515/1034] 10.222.0.47 () {64 vars in 1308 bytes} [Fri Feb 19 05:10:49 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 05:10:50.000253 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.network.neutron [None req-555cd532-bb46-4ac9-b9c0-1c901c0d81d7 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] [instance: 66b6840a-cca9-43d0-824e-2d492eb10b1d] Updating instance_info_cache with network_info: [{"id": "335386b1-d194-45cc-bccd-e8dfb53329a0", "address": "fa:16:3e:0c:c2:bb", "network": {"id": "6e82c627-b5d1-4c59-bf38-23c61d54a5a6", "bridge": "br-int", "label": "tempest-TestShelveInstance-86564370-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.27.0.85", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "95e9a5a891aa4f9184d68b7730fe8805", "mtu": 1450, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, "devname": "tap335386b1-d1", "ovs_interfaceid": "335386b1-d194-45cc-bccd-e8dfb53329a0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "meta": {}}] {{(pid=98154) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Feb 19 05:10:50.011102 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-555cd532-bb46-4ac9-b9c0-1c901c0d81d7 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Releasing lock "refresh_cache-66b6840a-cca9-43d0-824e-2d492eb10b1d" {{(pid=98154) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:282}} Feb 19 05:10:50.012769 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-555cd532-bb46-4ac9-b9c0-1c901c0d81d7 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] 10.222.0.47 "POST /compute/v2.1/servers/66b6840a-cca9-43d0-824e-2d492eb10b1d/action" status: 202 len: 0 microversion: 2.1 time: 2.965410 Feb 19 05:10:50.013809 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 520/1035] 10.222.0.47 () {60 vars in 1268 bytes} [Fri Feb 19 05:10:47 2021] POST /compute/v2.1/servers/66b6840a-cca9-43d0-824e-2d492eb10b1d/action => generated 0 bytes in 2968 msecs (HTTP/1.1 202) 9 headers in 369 bytes (2 switches on core 0) Feb 19 05:11:09.097835 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-ecc8f5ea-d6b9-40eb-a27e-ac11988f70ec tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-99207266", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1012313419", "security_groups": [{"name": "tempest-TestVolumeBootPattern-1266909124"}], "block_device_mapping_v2": [{"uuid": "e8ea505a-6c53-423c-9f73-f71c33b9341e", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "68c8736e-693c-40d6-962b-ec56c71786c4"}]}} {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:11:09.265818 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.network.neutron [None req-ecc8f5ea-d6b9-40eb-a27e-ac11988f70ec tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] validate_networks() for [('68c8736e-693c-40d6-962b-ec56c71786c4', None, None, None)] {{(pid=98153) validate_networks /opt/stack/nova/nova/network/neutron.py:2345}} Feb 19 05:11:09.936882 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.virt.hardware [None req-ecc8f5ea-d6b9-40eb-a27e-ac11988f70ec tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Flavor limits 0:0:0 {{(pid=98153) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 19 05:11:09.937365 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.virt.hardware [None req-ecc8f5ea-d6b9-40eb-a27e-ac11988f70ec tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Image limits 0:0:0 {{(pid=98153) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Feb 19 05:11:09.937910 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.virt.hardware [None req-ecc8f5ea-d6b9-40eb-a27e-ac11988f70ec tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Flavor pref 0:0:0 {{(pid=98153) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 19 05:11:09.938373 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.virt.hardware [None req-ecc8f5ea-d6b9-40eb-a27e-ac11988f70ec tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Image pref 0:0:0 {{(pid=98153) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Feb 19 05:11:09.940119 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.virt.hardware [None req-ecc8f5ea-d6b9-40eb-a27e-ac11988f70ec tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98153) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Feb 19 05:11:09.949254 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-ecc8f5ea-d6b9-40eb-a27e-ac11988f70ec tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:11:09.949762 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-ecc8f5ea-d6b9-40eb-a27e-ac11988f70ec tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:11:09.950707 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-ecc8f5ea-d6b9-40eb-a27e-ac11988f70ec tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:11:09.951135 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-ecc8f5ea-d6b9-40eb-a27e-ac11988f70ec tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:11:09.971892 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.quota [None req-ecc8f5ea-d6b9-40eb-a27e-ac11988f70ec tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Getting quotas for project f87857a2fc3a4866a8055ed181d12edf. Resources: {'instances', 'ram', 'cores'} {{(pid=98153) _get_quotas /opt/stack/nova/nova/quota.py:388}} Feb 19 05:11:09.976266 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.quota [None req-ecc8f5ea-d6b9-40eb-a27e-ac11988f70ec tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Getting quotas for user 32f894b7dad5447688fb395e08d31d4c and project f87857a2fc3a4866a8055ed181d12edf. Resources: {'instances', 'ram', 'cores'} {{(pid=98153) _get_quotas /opt/stack/nova/nova/quota.py:380}} Feb 19 05:11:10.093955 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-ecc8f5ea-d6b9-40eb-a27e-ac11988f70ec tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Going to run 1 instances... {{(pid=98153) _provision_instances /opt/stack/nova/nova/compute/api.py:1264}} Feb 19 05:11:10.097321 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-ecc8f5ea-d6b9-40eb-a27e-ac11988f70ec tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] [instance: 9aff0765-c40a-4a13-ad51-890bbf63fc48] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e8ea505a-6c53-423c-9f73-f71c33b9341e',volume_size=None,volume_type=None)] {{(pid=98153) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1666}} Feb 19 05:11:10.285351 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-ecc8f5ea-d6b9-40eb-a27e-ac11988f70ec tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 413 microversion: 2.1 time: 1.192835 Feb 19 05:11:10.286105 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 516/1036] 10.222.0.47 () {60 vars in 1137 bytes} [Fri Feb 19 05:11:09 2021] POST /compute/v2.1/servers => generated 413 bytes in 1195 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 19 05:11:10.294642 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: ERROR oslo.messaging._drivers.impl_rabbit [-] [deb0cc63-ccce-4796-b291-4054c1534647] AMQP server on 10.222.0.47:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Feb 19 05:11:10.298565 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-80dcc2ce-45b4-4233-b97d-ee4b024f48f4 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:11:10.299240 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-80dcc2ce-45b4-4233-b97d-ee4b024f48f4 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] [instance: 9aff0765-c40a-4a13-ad51-890bbf63fc48] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:11:10.383918 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-80dcc2ce-45b4-4233-b97d-ee4b024f48f4 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32f894b7dad5447688fb395e08d31d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87857a2fc3a4866a8055ed181d12edf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:11:10.395130 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-80dcc2ce-45b4-4233-b97d-ee4b024f48f4 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] 10.222.0.47 "GET /compute/v2.1/servers/9aff0765-c40a-4a13-ad51-890bbf63fc48" status: 200 len: 1093 microversion: 2.1 time: 0.102194 Feb 19 05:11:10.395783 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 521/1037] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:11:10 2021] GET /compute/v2.1/servers/9aff0765-c40a-4a13-ad51-890bbf63fc48 => generated 1093 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:11:11.413589 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-173b5bf3-b4d9-427e-bc9c-237368b05d18 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:11:11.414218 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-173b5bf3-b4d9-427e-bc9c-237368b05d18 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] [instance: 9aff0765-c40a-4a13-ad51-890bbf63fc48] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:11:11.423780 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-173b5bf3-b4d9-427e-bc9c-237368b05d18 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:11:11.424285 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-173b5bf3-b4d9-427e-bc9c-237368b05d18 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:11:11.425138 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-173b5bf3-b4d9-427e-bc9c-237368b05d18 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:11:11.425624 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-173b5bf3-b4d9-427e-bc9c-237368b05d18 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:11:11.563907 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-173b5bf3-b4d9-427e-bc9c-237368b05d18 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32f894b7dad5447688fb395e08d31d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87857a2fc3a4866a8055ed181d12edf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:11:11.572962 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-173b5bf3-b4d9-427e-bc9c-237368b05d18 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] 10.222.0.47 "GET /compute/v2.1/servers/9aff0765-c40a-4a13-ad51-890bbf63fc48" status: 200 len: 1199 microversion: 2.1 time: 0.163837 Feb 19 05:11:11.573726 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 517/1038] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:11:11 2021] GET /compute/v2.1/servers/9aff0765-c40a-4a13-ad51-890bbf63fc48 => generated 1199 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:11:12.593288 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-5577423a-6b58-4840-8a9a-d616b059653d tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:11:12.594551 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-5577423a-6b58-4840-8a9a-d616b059653d tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] [instance: 9aff0765-c40a-4a13-ad51-890bbf63fc48] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:11:12.617008 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-5577423a-6b58-4840-8a9a-d616b059653d tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:11:12.617512 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-5577423a-6b58-4840-8a9a-d616b059653d tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:11:12.618359 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-5577423a-6b58-4840-8a9a-d616b059653d tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:11:12.618848 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-5577423a-6b58-4840-8a9a-d616b059653d tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:11:12.683515 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO oslo.messaging._drivers.impl_rabbit [-] [deb0cc63-ccce-4796-b291-4054c1534647] Reconnected to AMQP server on 10.222.0.47:5672 via [amqp] client with port 60928. Feb 19 05:11:12.848290 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-5577423a-6b58-4840-8a9a-d616b059653d tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32f894b7dad5447688fb395e08d31d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87857a2fc3a4866a8055ed181d12edf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:11:12.857313 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-5577423a-6b58-4840-8a9a-d616b059653d tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] 10.222.0.47 "GET /compute/v2.1/servers/9aff0765-c40a-4a13-ad51-890bbf63fc48" status: 200 len: 1272 microversion: 2.1 time: 0.268340 Feb 19 05:11:12.857890 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 522/1039] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:11:12 2021] GET /compute/v2.1/servers/9aff0765-c40a-4a13-ad51-890bbf63fc48 => generated 1272 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:11:13.878864 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-645e2169-6f5b-4c5c-8c1f-2cec8c0a2468 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:11:13.879827 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-645e2169-6f5b-4c5c-8c1f-2cec8c0a2468 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] [instance: 9aff0765-c40a-4a13-ad51-890bbf63fc48] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:11:13.888593 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-645e2169-6f5b-4c5c-8c1f-2cec8c0a2468 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:11:13.889107 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-645e2169-6f5b-4c5c-8c1f-2cec8c0a2468 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:11:13.890019 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-645e2169-6f5b-4c5c-8c1f-2cec8c0a2468 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:11:13.890516 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-645e2169-6f5b-4c5c-8c1f-2cec8c0a2468 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:11:14.124686 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-645e2169-6f5b-4c5c-8c1f-2cec8c0a2468 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32f894b7dad5447688fb395e08d31d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87857a2fc3a4866a8055ed181d12edf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:11:14.134172 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-645e2169-6f5b-4c5c-8c1f-2cec8c0a2468 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] 10.222.0.47 "GET /compute/v2.1/servers/9aff0765-c40a-4a13-ad51-890bbf63fc48" status: 200 len: 1272 microversion: 2.1 time: 0.260999 Feb 19 05:11:14.134943 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 518/1040] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:11:13 2021] GET /compute/v2.1/servers/9aff0765-c40a-4a13-ad51-890bbf63fc48 => generated 1272 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:11:14.527769 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [req-bc7f0da6-6f11-4aff-b30e-8ca6e1dd4947 req-0179d3c7-3f69-4cfa-abf2-04612c2c8ec8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9aff0765-c40a-4a13-ad51-890bbf63fc48", "tag": "ff7bae65-f87f-45fd-a161-9185454b3da1"}]} {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:11:14.529750 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 05:11:14.529750 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: warnings.warn(msg) Feb 19 05:11:14.541606 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [req-bc7f0da6-6f11-4aff-b30e-8ca6e1dd4947 req-0179d3c7-3f69-4cfa-abf2-04612c2c8ec8 service nova] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:11:14.542114 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [req-bc7f0da6-6f11-4aff-b30e-8ca6e1dd4947 req-0179d3c7-3f69-4cfa-abf2-04612c2c8ec8 service nova] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:11:14.562227 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.compute.server_external_events [req-bc7f0da6-6f11-4aff-b30e-8ca6e1dd4947 req-0179d3c7-3f69-4cfa-abf2-04612c2c8ec8 service nova] Creating event network-changed:ff7bae65-f87f-45fd-a161-9185454b3da1 for instance 9aff0765-c40a-4a13-ad51-890bbf63fc48 on hv-cinder-77642 Feb 19 05:11:14.569532 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [req-bc7f0da6-6f11-4aff-b30e-8ca6e1dd4947 req-0179d3c7-3f69-4cfa-abf2-04612c2c8ec8 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046720 Feb 19 05:11:14.570350 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 523/1041] 10.222.0.47 () {64 vars in 1308 bytes} [Fri Feb 19 05:11:14 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 05:11:15.152784 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-708d1f7e-f2aa-4f2c-863e-90550407fcc6 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:11:15.153460 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-708d1f7e-f2aa-4f2c-863e-90550407fcc6 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] [instance: 9aff0765-c40a-4a13-ad51-890bbf63fc48] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:11:15.163086 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-708d1f7e-f2aa-4f2c-863e-90550407fcc6 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:11:15.163635 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-708d1f7e-f2aa-4f2c-863e-90550407fcc6 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:11:15.164485 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-708d1f7e-f2aa-4f2c-863e-90550407fcc6 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:11:15.164978 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-708d1f7e-f2aa-4f2c-863e-90550407fcc6 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:11:15.390045 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-708d1f7e-f2aa-4f2c-863e-90550407fcc6 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32f894b7dad5447688fb395e08d31d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87857a2fc3a4866a8055ed181d12edf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:11:15.399832 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-708d1f7e-f2aa-4f2c-863e-90550407fcc6 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] 10.222.0.47 "GET /compute/v2.1/servers/9aff0765-c40a-4a13-ad51-890bbf63fc48" status: 200 len: 1272 microversion: 2.1 time: 0.251040 Feb 19 05:11:15.400462 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 519/1042] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:11:15 2021] GET /compute/v2.1/servers/9aff0765-c40a-4a13-ad51-890bbf63fc48 => generated 1272 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:11:16.419268 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-765c9b51-2a63-4b8c-a2d2-1a3c9f079897 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:11:16.420068 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-765c9b51-2a63-4b8c-a2d2-1a3c9f079897 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] [instance: 9aff0765-c40a-4a13-ad51-890bbf63fc48] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:11:16.429105 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-765c9b51-2a63-4b8c-a2d2-1a3c9f079897 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:11:16.429616 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-765c9b51-2a63-4b8c-a2d2-1a3c9f079897 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:11:16.430466 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-765c9b51-2a63-4b8c-a2d2-1a3c9f079897 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:11:16.430963 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-765c9b51-2a63-4b8c-a2d2-1a3c9f079897 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:11:16.655237 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-765c9b51-2a63-4b8c-a2d2-1a3c9f079897 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32f894b7dad5447688fb395e08d31d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87857a2fc3a4866a8055ed181d12edf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:11:16.664518 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-765c9b51-2a63-4b8c-a2d2-1a3c9f079897 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] 10.222.0.47 "GET /compute/v2.1/servers/9aff0765-c40a-4a13-ad51-890bbf63fc48" status: 200 len: 1272 microversion: 2.1 time: 0.249798 Feb 19 05:11:16.665151 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 524/1043] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:11:16 2021] GET /compute/v2.1/servers/9aff0765-c40a-4a13-ad51-890bbf63fc48 => generated 1272 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:11:17.682380 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-179402e2-38cc-4a9f-9daa-196458770316 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:11:17.683131 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-179402e2-38cc-4a9f-9daa-196458770316 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] [instance: 9aff0765-c40a-4a13-ad51-890bbf63fc48] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:11:17.691505 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-179402e2-38cc-4a9f-9daa-196458770316 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:11:17.692021 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-179402e2-38cc-4a9f-9daa-196458770316 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:11:17.692864 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-179402e2-38cc-4a9f-9daa-196458770316 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:11:17.693348 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-179402e2-38cc-4a9f-9daa-196458770316 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:11:17.905260 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-179402e2-38cc-4a9f-9daa-196458770316 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32f894b7dad5447688fb395e08d31d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87857a2fc3a4866a8055ed181d12edf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:11:17.915564 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-179402e2-38cc-4a9f-9daa-196458770316 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] 10.222.0.47 "GET /compute/v2.1/servers/9aff0765-c40a-4a13-ad51-890bbf63fc48" status: 200 len: 1272 microversion: 2.1 time: 0.237099 Feb 19 05:11:17.916359 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 520/1044] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:11:17 2021] GET /compute/v2.1/servers/9aff0765-c40a-4a13-ad51-890bbf63fc48 => generated 1272 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:11:18.934084 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-262940b1-c541-4c15-9fb2-7c72519498c2 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:11:18.934713 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-262940b1-c541-4c15-9fb2-7c72519498c2 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] [instance: 9aff0765-c40a-4a13-ad51-890bbf63fc48] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:11:18.943181 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-262940b1-c541-4c15-9fb2-7c72519498c2 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:11:18.943819 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-262940b1-c541-4c15-9fb2-7c72519498c2 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:11:18.944655 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-262940b1-c541-4c15-9fb2-7c72519498c2 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:11:18.945140 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-262940b1-c541-4c15-9fb2-7c72519498c2 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:11:19.163412 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-262940b1-c541-4c15-9fb2-7c72519498c2 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32f894b7dad5447688fb395e08d31d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87857a2fc3a4866a8055ed181d12edf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:11:19.172295 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-262940b1-c541-4c15-9fb2-7c72519498c2 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] 10.222.0.47 "GET /compute/v2.1/servers/9aff0765-c40a-4a13-ad51-890bbf63fc48" status: 200 len: 1272 microversion: 2.1 time: 0.242378 Feb 19 05:11:19.172923 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 525/1045] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:11:18 2021] GET /compute/v2.1/servers/9aff0765-c40a-4a13-ad51-890bbf63fc48 => generated 1272 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:11:20.191263 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-5f9b42db-ea34-418b-a613-40cabfd9118e tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:11:20.191967 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-5f9b42db-ea34-418b-a613-40cabfd9118e tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] [instance: 9aff0765-c40a-4a13-ad51-890bbf63fc48] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:11:20.199894 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-5f9b42db-ea34-418b-a613-40cabfd9118e tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:11:20.200403 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-5f9b42db-ea34-418b-a613-40cabfd9118e tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:11:20.201242 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-5f9b42db-ea34-418b-a613-40cabfd9118e tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:11:20.201734 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-5f9b42db-ea34-418b-a613-40cabfd9118e tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:11:20.413447 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-5f9b42db-ea34-418b-a613-40cabfd9118e tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32f894b7dad5447688fb395e08d31d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87857a2fc3a4866a8055ed181d12edf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:11:20.422392 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-5f9b42db-ea34-418b-a613-40cabfd9118e tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] 10.222.0.47 "GET /compute/v2.1/servers/9aff0765-c40a-4a13-ad51-890bbf63fc48" status: 200 len: 1272 microversion: 2.1 time: 0.235972 Feb 19 05:11:20.423680 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 521/1046] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:11:20 2021] GET /compute/v2.1/servers/9aff0765-c40a-4a13-ad51-890bbf63fc48 => generated 1272 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:11:21.446172 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-7c911588-dbfc-4d60-a02b-57d0f8ce4924 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:11:21.446882 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-7c911588-dbfc-4d60-a02b-57d0f8ce4924 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] [instance: 9aff0765-c40a-4a13-ad51-890bbf63fc48] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:11:21.454911 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-7c911588-dbfc-4d60-a02b-57d0f8ce4924 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:11:21.455443 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-7c911588-dbfc-4d60-a02b-57d0f8ce4924 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:11:21.456282 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-7c911588-dbfc-4d60-a02b-57d0f8ce4924 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:11:21.456782 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-7c911588-dbfc-4d60-a02b-57d0f8ce4924 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:11:21.673910 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-7c911588-dbfc-4d60-a02b-57d0f8ce4924 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32f894b7dad5447688fb395e08d31d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87857a2fc3a4866a8055ed181d12edf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:11:21.682816 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-7c911588-dbfc-4d60-a02b-57d0f8ce4924 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] 10.222.0.47 "GET /compute/v2.1/servers/9aff0765-c40a-4a13-ad51-890bbf63fc48" status: 200 len: 1272 microversion: 2.1 time: 0.240655 Feb 19 05:11:21.683475 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 526/1047] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:11:21 2021] GET /compute/v2.1/servers/9aff0765-c40a-4a13-ad51-890bbf63fc48 => generated 1272 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:11:22.702281 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-bc9ac5f8-0acf-4605-b570-155d7525caf4 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:11:22.702961 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-bc9ac5f8-0acf-4605-b570-155d7525caf4 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] [instance: 9aff0765-c40a-4a13-ad51-890bbf63fc48] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:11:22.711828 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-bc9ac5f8-0acf-4605-b570-155d7525caf4 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:11:22.712327 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-bc9ac5f8-0acf-4605-b570-155d7525caf4 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:11:22.713207 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-bc9ac5f8-0acf-4605-b570-155d7525caf4 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:11:22.713695 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-bc9ac5f8-0acf-4605-b570-155d7525caf4 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:11:22.812246 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [req-b7067e57-25ee-4ab8-9a54-2bd39dce0334 req-cc31da4c-fa18-4e61-b973-7827de176a6d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9aff0765-c40a-4a13-ad51-890bbf63fc48", "name": "network-vif-plugged", "status": "completed", "tag": "ff7bae65-f87f-45fd-a161-9185454b3da1"}]} {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:11:22.813936 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 05:11:22.813936 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: warnings.warn(msg) Feb 19 05:11:22.823160 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [req-b7067e57-25ee-4ab8-9a54-2bd39dce0334 req-cc31da4c-fa18-4e61-b973-7827de176a6d service nova] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:11:22.823910 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [req-b7067e57-25ee-4ab8-9a54-2bd39dce0334 req-cc31da4c-fa18-4e61-b973-7827de176a6d service nova] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:11:22.842219 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.compute.server_external_events [req-b7067e57-25ee-4ab8-9a54-2bd39dce0334 req-cc31da4c-fa18-4e61-b973-7827de176a6d service nova] Creating event network-vif-plugged:ff7bae65-f87f-45fd-a161-9185454b3da1 for instance 9aff0765-c40a-4a13-ad51-890bbf63fc48 on hv-cinder-77642 Feb 19 05:11:22.848248 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [req-b7067e57-25ee-4ab8-9a54-2bd39dce0334 req-cc31da4c-fa18-4e61-b973-7827de176a6d service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111006 Feb 19 05:11:22.848930 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 527/1048] 10.222.0.47 () {64 vars in 1308 bytes} [Fri Feb 19 05:11:22 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 19 05:11:22.941228 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-bc9ac5f8-0acf-4605-b570-155d7525caf4 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32f894b7dad5447688fb395e08d31d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87857a2fc3a4866a8055ed181d12edf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:11:22.951005 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-bc9ac5f8-0acf-4605-b570-155d7525caf4 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] 10.222.0.47 "GET /compute/v2.1/servers/9aff0765-c40a-4a13-ad51-890bbf63fc48" status: 200 len: 1272 microversion: 2.1 time: 0.252809 Feb 19 05:11:22.951613 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 522/1049] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:11:22 2021] GET /compute/v2.1/servers/9aff0765-c40a-4a13-ad51-890bbf63fc48 => generated 1272 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:11:23.970535 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-e929a7fe-bfa0-4e49-a6db-761b89651eda tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:11:23.971299 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-e929a7fe-bfa0-4e49-a6db-761b89651eda tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] [instance: 9aff0765-c40a-4a13-ad51-890bbf63fc48] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:11:23.979511 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-e929a7fe-bfa0-4e49-a6db-761b89651eda tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:11:23.980019 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-e929a7fe-bfa0-4e49-a6db-761b89651eda tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:11:23.980856 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-e929a7fe-bfa0-4e49-a6db-761b89651eda tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:11:23.981344 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-e929a7fe-bfa0-4e49-a6db-761b89651eda tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:11:24.200060 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-e929a7fe-bfa0-4e49-a6db-761b89651eda tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32f894b7dad5447688fb395e08d31d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87857a2fc3a4866a8055ed181d12edf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:11:24.212728 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-e929a7fe-bfa0-4e49-a6db-761b89651eda tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] 10.222.0.47 "GET /compute/v2.1/servers/9aff0765-c40a-4a13-ad51-890bbf63fc48" status: 200 len: 1272 microversion: 2.1 time: 0.246909 Feb 19 05:11:24.213378 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 528/1050] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:11:23 2021] GET /compute/v2.1/servers/9aff0765-c40a-4a13-ad51-890bbf63fc48 => generated 1272 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:11:25.231261 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-10396fb5-ab11-4720-934d-d557e17c5fec tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:11:25.231957 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-10396fb5-ab11-4720-934d-d557e17c5fec tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] [instance: 9aff0765-c40a-4a13-ad51-890bbf63fc48] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:11:25.239936 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-10396fb5-ab11-4720-934d-d557e17c5fec tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:11:25.240436 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-10396fb5-ab11-4720-934d-d557e17c5fec tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:11:25.241274 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-10396fb5-ab11-4720-934d-d557e17c5fec tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:11:25.241762 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-10396fb5-ab11-4720-934d-d557e17c5fec tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:11:25.452706 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-10396fb5-ab11-4720-934d-d557e17c5fec tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32f894b7dad5447688fb395e08d31d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87857a2fc3a4866a8055ed181d12edf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:11:25.462628 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-10396fb5-ab11-4720-934d-d557e17c5fec tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] 10.222.0.47 "GET /compute/v2.1/servers/9aff0765-c40a-4a13-ad51-890bbf63fc48" status: 200 len: 1458 microversion: 2.1 time: 0.235323 Feb 19 05:11:25.463269 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 523/1051] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:11:25 2021] GET /compute/v2.1/servers/9aff0765-c40a-4a13-ad51-890bbf63fc48 => generated 1458 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:11:25.481173 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-467970fa-4025-4467-b611-762f532296bd tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:11:25.481844 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-467970fa-4025-4467-b611-762f532296bd tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] [instance: 9aff0765-c40a-4a13-ad51-890bbf63fc48] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:11:25.490426 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-467970fa-4025-4467-b611-762f532296bd tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:11:25.490934 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-467970fa-4025-4467-b611-762f532296bd tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:11:25.491804 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-467970fa-4025-4467-b611-762f532296bd tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:11:25.492297 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-467970fa-4025-4467-b611-762f532296bd tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:11:25.708454 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-467970fa-4025-4467-b611-762f532296bd tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32f894b7dad5447688fb395e08d31d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87857a2fc3a4866a8055ed181d12edf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:11:25.717370 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-467970fa-4025-4467-b611-762f532296bd tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] 10.222.0.47 "GET /compute/v2.1/servers/9aff0765-c40a-4a13-ad51-890bbf63fc48" status: 200 len: 1458 microversion: 2.1 time: 0.240246 Feb 19 05:11:25.717996 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 529/1052] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:11:25 2021] GET /compute/v2.1/servers/9aff0765-c40a-4a13-ad51-890bbf63fc48 => generated 1458 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:11:25.735892 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-6a8dadda-16ce-4220-ae75-2e177585236b tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Action: 'create', calling method: .version_select at 0x7f27067ca378>, body: {"pool": null} {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:11:28.018392 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-6a8dadda-16ce-4220-ae75-2e177585236b tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] 10.222.0.47 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 2.286544 Feb 19 05:11:28.019516 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 524/1053] 10.222.0.47 () {60 vars in 1160 bytes} [Fri Feb 19 05:11:25 2021] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 2289 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 05:11:28.031214 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-686f9d7a-d0d4-46a8-a4d8-5368bddb12a4 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.27.0.66"}} {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:11:28.032997 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-686f9d7a-d0d4-46a8-a4d8-5368bddb12a4 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] [instance: 9aff0765-c40a-4a13-ad51-890bbf63fc48] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:11:28.040925 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-686f9d7a-d0d4-46a8-a4d8-5368bddb12a4 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:11:28.041436 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-686f9d7a-d0d4-46a8-a4d8-5368bddb12a4 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:11:28.042271 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-686f9d7a-d0d4-46a8-a4d8-5368bddb12a4 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:11:28.042770 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-686f9d7a-d0d4-46a8-a4d8-5368bddb12a4 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:11:28.109281 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-686f9d7a-d0d4-46a8-a4d8-5368bddb12a4 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Acquired lock "refresh_cache-9aff0765-c40a-4a13-ad51-890bbf63fc48" {{(pid=98154) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:266}} Feb 19 05:11:30.143518 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.network.neutron [None req-686f9d7a-d0d4-46a8-a4d8-5368bddb12a4 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] [instance: 9aff0765-c40a-4a13-ad51-890bbf63fc48] Building network info cache for instance {{(pid=98154) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1836}} Feb 19 05:11:30.150178 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a21ee3a4-3140-499c-b569-9ae072d4f02c] AMQP server on 10.222.0.47:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Feb 19 05:11:30.153975 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [req-6d753b82-692b-45a3-b449-fd5b27a6b9fd req-890ab0b4-5712-4b61-b0af-1b78b41f2964 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9aff0765-c40a-4a13-ad51-890bbf63fc48", "tag": "ff7bae65-f87f-45fd-a161-9185454b3da1"}]} {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:11:30.156021 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 05:11:30.156021 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: warnings.warn(msg) Feb 19 05:11:30.165787 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [req-6d753b82-692b-45a3-b449-fd5b27a6b9fd req-890ab0b4-5712-4b61-b0af-1b78b41f2964 service nova] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:11:30.166384 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [req-6d753b82-692b-45a3-b449-fd5b27a6b9fd req-890ab0b4-5712-4b61-b0af-1b78b41f2964 service nova] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:11:30.184720 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.compute.server_external_events [req-6d753b82-692b-45a3-b449-fd5b27a6b9fd req-890ab0b4-5712-4b61-b0af-1b78b41f2964 service nova] Creating event network-changed:ff7bae65-f87f-45fd-a161-9185454b3da1 for instance 9aff0765-c40a-4a13-ad51-890bbf63fc48 on hv-cinder-77642 Feb 19 05:11:30.190560 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [req-6d753b82-692b-45a3-b449-fd5b27a6b9fd req-890ab0b4-5712-4b61-b0af-1b78b41f2964 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041707 Feb 19 05:11:30.191515 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 525/1054] 10.222.0.47 () {64 vars in 1308 bytes} [Fri Feb 19 05:11:30 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 05:11:31.011591 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.network.neutron [None req-686f9d7a-d0d4-46a8-a4d8-5368bddb12a4 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] [instance: 9aff0765-c40a-4a13-ad51-890bbf63fc48] Updating instance_info_cache with network_info: [{"id": "ff7bae65-f87f-45fd-a161-9185454b3da1", "address": "fa:16:3e:c3:fc:40", "network": {"id": "68c8736e-693c-40d6-962b-ec56c71786c4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-815410707-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.27.0.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "f87857a2fc3a4866a8055ed181d12edf", "mtu": 1450, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, "devname": "tapff7bae65-f8", "ovs_interfaceid": "ff7bae65-f87f-45fd-a161-9185454b3da1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "meta": {}}] {{(pid=98154) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Feb 19 05:11:31.024511 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-686f9d7a-d0d4-46a8-a4d8-5368bddb12a4 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Releasing lock "refresh_cache-9aff0765-c40a-4a13-ad51-890bbf63fc48" {{(pid=98154) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:282}} Feb 19 05:11:31.025642 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-686f9d7a-d0d4-46a8-a4d8-5368bddb12a4 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] 10.222.0.47 "POST /compute/v2.1/servers/9aff0765-c40a-4a13-ad51-890bbf63fc48/action" status: 202 len: 0 microversion: 2.1 time: 2.998552 Feb 19 05:11:31.027384 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 530/1055] 10.222.0.47 () {60 vars in 1268 bytes} [Fri Feb 19 05:11:28 2021] POST /compute/v2.1/servers/9aff0765-c40a-4a13-ad51-890bbf63fc48/action => generated 0 bytes in 3000 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Feb 19 05:11:48.489225 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 19 05:11:48.489837 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: Fri Feb 19 05:11:48 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 19 05:12:44.367687 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-73e44a53-38c3-4697-8688-4fc9ad8e7c88 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:12:44.368392 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-73e44a53-38c3-4697-8688-4fc9ad8e7c88 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] [instance: 66b6840a-cca9-43d0-824e-2d492eb10b1d] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:12:44.378806 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-73e44a53-38c3-4697-8688-4fc9ad8e7c88 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:12:44.379356 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-73e44a53-38c3-4697-8688-4fc9ad8e7c88 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:12:44.380222 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-73e44a53-38c3-4697-8688-4fc9ad8e7c88 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:12:44.380726 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-73e44a53-38c3-4697-8688-4fc9ad8e7c88 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:12:44.418936 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO oslo.messaging._drivers.impl_rabbit [-] [a21ee3a4-3140-499c-b569-9ae072d4f02c] Reconnected to AMQP server on 10.222.0.47:5672 via [amqp] client with port 60990. Feb 19 05:12:44.449329 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.objects.instance [None req-73e44a53-38c3-4697-8688-4fc9ad8e7c88 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Lazy-loading 'flavor' on Instance uuid 66b6840a-cca9-43d0-824e-2d492eb10b1d {{(pid=98153) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Feb 19 05:12:44.602914 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-73e44a53-38c3-4697-8688-4fc9ad8e7c88 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] 10.222.0.47 "POST /compute/v2.1/servers/66b6840a-cca9-43d0-824e-2d492eb10b1d/action" status: 202 len: 0 microversion: 2.1 time: 0.249937 Feb 19 05:12:44.603711 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 526/1056] 10.222.0.47 () {60 vars in 1268 bytes} [Fri Feb 19 05:12:44 2021] POST /compute/v2.1/servers/66b6840a-cca9-43d0-824e-2d492eb10b1d/action => generated 0 bytes in 252 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 19 05:12:44.614734 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-232a9cd2-cefd-462e-946e-c8704e4286e5 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:12:44.615439 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-232a9cd2-cefd-462e-946e-c8704e4286e5 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] [instance: 66b6840a-cca9-43d0-824e-2d492eb10b1d] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:12:44.624856 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-232a9cd2-cefd-462e-946e-c8704e4286e5 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:12:44.625293 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-232a9cd2-cefd-462e-946e-c8704e4286e5 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:12:44.626170 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-232a9cd2-cefd-462e-946e-c8704e4286e5 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:12:44.627549 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-232a9cd2-cefd-462e-946e-c8704e4286e5 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:12:44.857749 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-232a9cd2-cefd-462e-946e-c8704e4286e5 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '878e94e8d400454790f54697f9a8f9e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e9a5a891aa4f9184d68b7730fe8805', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:12:44.867914 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-232a9cd2-cefd-462e-946e-c8704e4286e5 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] 10.222.0.47 "GET /compute/v2.1/servers/66b6840a-cca9-43d0-824e-2d492eb10b1d" status: 200 len: 1569 microversion: 2.1 time: 0.258169 Feb 19 05:12:44.868571 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 531/1057] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:12:44 2021] GET /compute/v2.1/servers/66b6840a-cca9-43d0-824e-2d492eb10b1d => generated 1569 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:12:45.888624 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-13b90ff1-445e-4a2b-a121-2a48323fb8db tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:12:45.889669 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-13b90ff1-445e-4a2b-a121-2a48323fb8db tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] [instance: 66b6840a-cca9-43d0-824e-2d492eb10b1d] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:12:45.898956 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-13b90ff1-445e-4a2b-a121-2a48323fb8db tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:12:45.899512 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-13b90ff1-445e-4a2b-a121-2a48323fb8db tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:12:45.900373 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-13b90ff1-445e-4a2b-a121-2a48323fb8db tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:12:45.900868 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-13b90ff1-445e-4a2b-a121-2a48323fb8db tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:12:46.133296 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-13b90ff1-445e-4a2b-a121-2a48323fb8db tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '878e94e8d400454790f54697f9a8f9e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e9a5a891aa4f9184d68b7730fe8805', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:12:46.143867 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-13b90ff1-445e-4a2b-a121-2a48323fb8db tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] 10.222.0.47 "GET /compute/v2.1/servers/66b6840a-cca9-43d0-824e-2d492eb10b1d" status: 200 len: 1569 microversion: 2.1 time: 0.259557 Feb 19 05:12:46.144438 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 527/1058] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:12:45 2021] GET /compute/v2.1/servers/66b6840a-cca9-43d0-824e-2d492eb10b1d => generated 1569 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:12:47.163358 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-214ad736-b585-486b-a794-a9bef20e62d9 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:12:47.164054 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-214ad736-b585-486b-a794-a9bef20e62d9 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] [instance: 66b6840a-cca9-43d0-824e-2d492eb10b1d] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:12:47.172228 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-214ad736-b585-486b-a794-a9bef20e62d9 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:12:47.172734 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-214ad736-b585-486b-a794-a9bef20e62d9 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:12:47.174281 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-214ad736-b585-486b-a794-a9bef20e62d9 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:12:47.174774 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-214ad736-b585-486b-a794-a9bef20e62d9 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:12:47.395053 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-214ad736-b585-486b-a794-a9bef20e62d9 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '878e94e8d400454790f54697f9a8f9e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e9a5a891aa4f9184d68b7730fe8805', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:12:47.405602 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-214ad736-b585-486b-a794-a9bef20e62d9 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] 10.222.0.47 "GET /compute/v2.1/servers/66b6840a-cca9-43d0-824e-2d492eb10b1d" status: 200 len: 1569 microversion: 2.1 time: 0.245345 Feb 19 05:12:47.406286 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 532/1059] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:12:47 2021] GET /compute/v2.1/servers/66b6840a-cca9-43d0-824e-2d492eb10b1d => generated 1569 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:12:48.425954 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-c658a18e-caf6-4efe-851d-7263f58c51d3 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:12:48.426633 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-c658a18e-caf6-4efe-851d-7263f58c51d3 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] [instance: 66b6840a-cca9-43d0-824e-2d492eb10b1d] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:12:48.434889 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-c658a18e-caf6-4efe-851d-7263f58c51d3 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:12:48.435448 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-c658a18e-caf6-4efe-851d-7263f58c51d3 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:12:48.436307 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-c658a18e-caf6-4efe-851d-7263f58c51d3 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:12:48.436801 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-c658a18e-caf6-4efe-851d-7263f58c51d3 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:12:48.671117 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-c658a18e-caf6-4efe-851d-7263f58c51d3 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '878e94e8d400454790f54697f9a8f9e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e9a5a891aa4f9184d68b7730fe8805', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:12:48.681134 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-c658a18e-caf6-4efe-851d-7263f58c51d3 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] 10.222.0.47 "GET /compute/v2.1/servers/66b6840a-cca9-43d0-824e-2d492eb10b1d" status: 200 len: 1569 microversion: 2.1 time: 0.259365 Feb 19 05:12:48.681700 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 528/1060] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:12:48 2021] GET /compute/v2.1/servers/66b6840a-cca9-43d0-824e-2d492eb10b1d => generated 1569 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:12:48.800038 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-ce7ae922-a0df-49e6-a730-7902a58133d9 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Calling method '.version_select at 0x7f27067a30d0>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:12:49.306694 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-ce7ae922-a0df-49e6-a730-7902a58133d9 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] [instance: 9aff0765-c40a-4a13-ad51-890bbf63fc48] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:12:49.315540 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-ce7ae922-a0df-49e6-a730-7902a58133d9 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:12:49.316050 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-ce7ae922-a0df-49e6-a730-7902a58133d9 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:12:49.316900 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-ce7ae922-a0df-49e6-a730-7902a58133d9 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:12:49.317390 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-ce7ae922-a0df-49e6-a730-7902a58133d9 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:12:49.383945 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-ce7ae922-a0df-49e6-a730-7902a58133d9 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Acquired lock "refresh_cache-9aff0765-c40a-4a13-ad51-890bbf63fc48" {{(pid=98154) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:266}} Feb 19 05:12:49.700933 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-d62feec2-02a2-445c-aa9b-dd86d9971c04 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:12:49.701613 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-d62feec2-02a2-445c-aa9b-dd86d9971c04 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] [instance: 66b6840a-cca9-43d0-824e-2d492eb10b1d] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:12:49.710492 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-d62feec2-02a2-445c-aa9b-dd86d9971c04 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:12:49.711003 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-d62feec2-02a2-445c-aa9b-dd86d9971c04 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:12:49.711898 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-d62feec2-02a2-445c-aa9b-dd86d9971c04 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:12:49.712388 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-d62feec2-02a2-445c-aa9b-dd86d9971c04 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:12:50.186228 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-d62feec2-02a2-445c-aa9b-dd86d9971c04 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '878e94e8d400454790f54697f9a8f9e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e9a5a891aa4f9184d68b7730fe8805', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:12:50.196423 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-d62feec2-02a2-445c-aa9b-dd86d9971c04 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] 10.222.0.47 "GET /compute/v2.1/servers/66b6840a-cca9-43d0-824e-2d492eb10b1d" status: 200 len: 1569 microversion: 2.1 time: 0.499689 Feb 19 05:12:50.197077 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 529/1061] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:12:49 2021] GET /compute/v2.1/servers/66b6840a-cca9-43d0-824e-2d492eb10b1d => generated 1569 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:12:51.214760 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-c159014a-5844-4ea6-95f5-a22e74badcc6 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:12:51.215483 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-c159014a-5844-4ea6-95f5-a22e74badcc6 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] [instance: 66b6840a-cca9-43d0-824e-2d492eb10b1d] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:12:51.224224 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-c159014a-5844-4ea6-95f5-a22e74badcc6 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:12:51.224745 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-c159014a-5844-4ea6-95f5-a22e74badcc6 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:12:51.225625 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-c159014a-5844-4ea6-95f5-a22e74badcc6 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:12:51.226118 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-c159014a-5844-4ea6-95f5-a22e74badcc6 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:12:51.665321 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-c159014a-5844-4ea6-95f5-a22e74badcc6 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '878e94e8d400454790f54697f9a8f9e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e9a5a891aa4f9184d68b7730fe8805', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:12:51.678559 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-c159014a-5844-4ea6-95f5-a22e74badcc6 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] 10.222.0.47 "GET /compute/v2.1/servers/66b6840a-cca9-43d0-824e-2d492eb10b1d" status: 200 len: 1569 microversion: 2.1 time: 0.467873 Feb 19 05:12:51.679222 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 530/1062] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:12:51 2021] GET /compute/v2.1/servers/66b6840a-cca9-43d0-824e-2d492eb10b1d => generated 1569 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 05:12:51.687060 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.network.neutron [None req-ce7ae922-a0df-49e6-a730-7902a58133d9 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] [instance: 9aff0765-c40a-4a13-ad51-890bbf63fc48] Building network info cache for instance {{(pid=98154) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1836}} Feb 19 05:12:51.703205 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [req-61afd1dc-fa61-4cc4-a3cf-6b2d9aa66d8a req-da4bb7c8-4e3f-4e64-9e33-ba0e43226d91 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9aff0765-c40a-4a13-ad51-890bbf63fc48", "tag": "ff7bae65-f87f-45fd-a161-9185454b3da1"}]} {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:12:51.705481 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 05:12:51.705481 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: warnings.warn(msg) Feb 19 05:12:51.715025 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [req-61afd1dc-fa61-4cc4-a3cf-6b2d9aa66d8a req-da4bb7c8-4e3f-4e64-9e33-ba0e43226d91 service nova] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:12:51.715462 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [req-61afd1dc-fa61-4cc4-a3cf-6b2d9aa66d8a req-da4bb7c8-4e3f-4e64-9e33-ba0e43226d91 service nova] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:12:51.734763 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.compute.server_external_events [req-61afd1dc-fa61-4cc4-a3cf-6b2d9aa66d8a req-da4bb7c8-4e3f-4e64-9e33-ba0e43226d91 service nova] Creating event network-changed:ff7bae65-f87f-45fd-a161-9185454b3da1 for instance 9aff0765-c40a-4a13-ad51-890bbf63fc48 on hv-cinder-77642 Feb 19 05:12:51.740933 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [req-61afd1dc-fa61-4cc4-a3cf-6b2d9aa66d8a req-da4bb7c8-4e3f-4e64-9e33-ba0e43226d91 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043504 Feb 19 05:12:51.741757 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 531/1063] 10.222.0.47 () {64 vars in 1308 bytes} [Fri Feb 19 05:12:51 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 05:12:52.539169 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.network.neutron [None req-ce7ae922-a0df-49e6-a730-7902a58133d9 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] [instance: 9aff0765-c40a-4a13-ad51-890bbf63fc48] Updating instance_info_cache with network_info: [{"id": "ff7bae65-f87f-45fd-a161-9185454b3da1", "address": "fa:16:3e:c3:fc:40", "network": {"id": "68c8736e-693c-40d6-962b-ec56c71786c4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-815410707-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "f87857a2fc3a4866a8055ed181d12edf", "mtu": 1450, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, "devname": "tapff7bae65-f8", "ovs_interfaceid": "ff7bae65-f87f-45fd-a161-9185454b3da1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "meta": {}}] {{(pid=98154) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Feb 19 05:12:52.551070 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-ce7ae922-a0df-49e6-a730-7902a58133d9 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Releasing lock "refresh_cache-9aff0765-c40a-4a13-ad51-890bbf63fc48" {{(pid=98154) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:282}} Feb 19 05:12:52.552063 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-ce7ae922-a0df-49e6-a730-7902a58133d9 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] 10.222.0.47 "DELETE /compute/v2.1/os-floating-ips/9ec398c6-0bfb-4cee-b276-e23bfb5fe3ba" status: 202 len: 0 microversion: 2.1 time: 3.756587 Feb 19 05:12:52.552715 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 533/1064] 10.222.0.47 () {58 vars in 1253 bytes} [Fri Feb 19 05:12:48 2021] DELETE /compute/v2.1/os-floating-ips/9ec398c6-0bfb-4cee-b276-e23bfb5fe3ba => generated 0 bytes in 3758 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 19 05:12:52.564603 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-3fee5afb-114b-4858-9abc-1631816fc0be tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:12:52.565889 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-3fee5afb-114b-4858-9abc-1631816fc0be tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] [instance: 9aff0765-c40a-4a13-ad51-890bbf63fc48] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:12:52.575960 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-3fee5afb-114b-4858-9abc-1631816fc0be tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:12:52.576594 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-3fee5afb-114b-4858-9abc-1631816fc0be tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:12:52.577553 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-3fee5afb-114b-4858-9abc-1631816fc0be tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:12:52.578136 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-3fee5afb-114b-4858-9abc-1631816fc0be tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:12:52.682386 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-3fee5afb-114b-4858-9abc-1631816fc0be tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] [instance: 9aff0765-c40a-4a13-ad51-890bbf63fc48] Going to try to terminate instance {{(pid=98153) delete /opt/stack/nova/nova/compute/api.py:2540}} Feb 19 05:12:52.699129 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-97729375-79e7-4e6f-bbbb-9c7290680108 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:12:52.700188 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-97729375-79e7-4e6f-bbbb-9c7290680108 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] [instance: 66b6840a-cca9-43d0-824e-2d492eb10b1d] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:12:52.708660 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-97729375-79e7-4e6f-bbbb-9c7290680108 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:12:52.709271 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-97729375-79e7-4e6f-bbbb-9c7290680108 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:12:52.710256 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-97729375-79e7-4e6f-bbbb-9c7290680108 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:12:52.710944 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-97729375-79e7-4e6f-bbbb-9c7290680108 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:12:52.836733 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-3fee5afb-114b-4858-9abc-1631816fc0be tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] 10.222.0.47 "DELETE /compute/v2.1/servers/9aff0765-c40a-4a13-ad51-890bbf63fc48" status: 204 len: 0 microversion: 2.1 time: 0.277918 Feb 19 05:12:52.837637 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 532/1065] 10.222.0.47 () {58 vars in 1229 bytes} [Fri Feb 19 05:12:52 2021] DELETE /compute/v2.1/servers/9aff0765-c40a-4a13-ad51-890bbf63fc48 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 19 05:12:52.848290 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-b25035de-06af-4826-9dd5-a8028d744e70 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:12:52.849084 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-b25035de-06af-4826-9dd5-a8028d744e70 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] [instance: 9aff0765-c40a-4a13-ad51-890bbf63fc48] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:12:52.857380 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-b25035de-06af-4826-9dd5-a8028d744e70 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:12:52.858307 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-b25035de-06af-4826-9dd5-a8028d744e70 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:12:52.858706 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-b25035de-06af-4826-9dd5-a8028d744e70 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:12:52.859195 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-b25035de-06af-4826-9dd5-a8028d744e70 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:12:52.957288 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-97729375-79e7-4e6f-bbbb-9c7290680108 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '878e94e8d400454790f54697f9a8f9e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e9a5a891aa4f9184d68b7730fe8805', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:12:52.975901 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-97729375-79e7-4e6f-bbbb-9c7290680108 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] 10.222.0.47 "GET /compute/v2.1/servers/66b6840a-cca9-43d0-824e-2d492eb10b1d" status: 200 len: 1569 microversion: 2.1 time: 0.280751 Feb 19 05:12:52.977090 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 534/1066] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:12:52 2021] GET /compute/v2.1/servers/66b6840a-cca9-43d0-824e-2d492eb10b1d => generated 1569 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 05:12:53.144682 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-b25035de-06af-4826-9dd5-a8028d744e70 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32f894b7dad5447688fb395e08d31d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87857a2fc3a4866a8055ed181d12edf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:12:53.155039 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-b25035de-06af-4826-9dd5-a8028d744e70 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] 10.222.0.47 "GET /compute/v2.1/servers/9aff0765-c40a-4a13-ad51-890bbf63fc48" status: 200 len: 1464 microversion: 2.1 time: 0.312168 Feb 19 05:12:53.156239 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 533/1067] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:12:52 2021] GET /compute/v2.1/servers/9aff0765-c40a-4a13-ad51-890bbf63fc48 => generated 1464 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:12:54.007525 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-2728f80b-a271-45a7-82c5-1924286802f2 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:12:54.008621 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-2728f80b-a271-45a7-82c5-1924286802f2 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] [instance: 66b6840a-cca9-43d0-824e-2d492eb10b1d] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:12:54.017881 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-2728f80b-a271-45a7-82c5-1924286802f2 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:12:54.018424 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-2728f80b-a271-45a7-82c5-1924286802f2 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:12:54.019280 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-2728f80b-a271-45a7-82c5-1924286802f2 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:12:54.019799 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-2728f80b-a271-45a7-82c5-1924286802f2 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:12:54.174218 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-28ee50b5-2113-46cd-982e-1964119b406d tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:12:54.175084 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-28ee50b5-2113-46cd-982e-1964119b406d tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] [instance: 9aff0765-c40a-4a13-ad51-890bbf63fc48] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:12:54.183052 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-28ee50b5-2113-46cd-982e-1964119b406d tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:12:54.183743 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-28ee50b5-2113-46cd-982e-1964119b406d tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:12:54.184938 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-28ee50b5-2113-46cd-982e-1964119b406d tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:12:54.184938 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-28ee50b5-2113-46cd-982e-1964119b406d tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:12:54.249492 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-2728f80b-a271-45a7-82c5-1924286802f2 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '878e94e8d400454790f54697f9a8f9e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e9a5a891aa4f9184d68b7730fe8805', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:12:54.259430 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-2728f80b-a271-45a7-82c5-1924286802f2 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] 10.222.0.47 "GET /compute/v2.1/servers/66b6840a-cca9-43d0-824e-2d492eb10b1d" status: 200 len: 1569 microversion: 2.1 time: 0.256212 Feb 19 05:12:54.260073 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 535/1068] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:12:54 2021] GET /compute/v2.1/servers/66b6840a-cca9-43d0-824e-2d492eb10b1d => generated 1569 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:12:54.427112 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-28ee50b5-2113-46cd-982e-1964119b406d tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32f894b7dad5447688fb395e08d31d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87857a2fc3a4866a8055ed181d12edf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:12:54.436610 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-28ee50b5-2113-46cd-982e-1964119b406d tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] 10.222.0.47 "GET /compute/v2.1/servers/9aff0765-c40a-4a13-ad51-890bbf63fc48" status: 200 len: 1464 microversion: 2.1 time: 0.266874 Feb 19 05:12:54.437271 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 534/1069] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:12:54 2021] GET /compute/v2.1/servers/9aff0765-c40a-4a13-ad51-890bbf63fc48 => generated 1464 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 05:12:55.295571 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-815fedf6-1596-4566-bcf0-5abc17f6d12a tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:12:55.296260 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-815fedf6-1596-4566-bcf0-5abc17f6d12a tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] [instance: 66b6840a-cca9-43d0-824e-2d492eb10b1d] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:12:55.309519 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-815fedf6-1596-4566-bcf0-5abc17f6d12a tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:12:55.311068 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-815fedf6-1596-4566-bcf0-5abc17f6d12a tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:12:55.312798 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-815fedf6-1596-4566-bcf0-5abc17f6d12a tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:12:55.314348 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-815fedf6-1596-4566-bcf0-5abc17f6d12a tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:12:55.457101 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-bd0955b3-2e07-4278-875d-b869f4f48e3e tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:12:55.457797 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-bd0955b3-2e07-4278-875d-b869f4f48e3e tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] [instance: 9aff0765-c40a-4a13-ad51-890bbf63fc48] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:12:55.466812 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-bd0955b3-2e07-4278-875d-b869f4f48e3e tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:12:55.467317 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-bd0955b3-2e07-4278-875d-b869f4f48e3e tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:12:55.468196 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-bd0955b3-2e07-4278-875d-b869f4f48e3e tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:12:55.468685 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-bd0955b3-2e07-4278-875d-b869f4f48e3e tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:12:55.492712 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 19 05:12:55.493120 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: Fri Feb 19 05:12:55 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/66b6840a-cca9-43d0-824e-2d492eb10b1d (ip 10.222.0.47) !!! Feb 19 05:12:55.759054 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-bd0955b3-2e07-4278-875d-b869f4f48e3e tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32f894b7dad5447688fb395e08d31d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87857a2fc3a4866a8055ed181d12edf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:12:55.773919 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-bd0955b3-2e07-4278-875d-b869f4f48e3e tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] 10.222.0.47 "GET /compute/v2.1/servers/9aff0765-c40a-4a13-ad51-890bbf63fc48" status: 200 len: 1389 microversion: 2.1 time: 0.321663 Feb 19 05:12:55.774681 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 535/1070] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:12:55 2021] GET /compute/v2.1/servers/9aff0765-c40a-4a13-ad51-890bbf63fc48 => generated 1389 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:12:55.790617 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [req-a85e0957-1f95-4509-8401-b6afb01a0add req-f53941f1-337e-4f46-ae8f-350e75b05a16 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9aff0765-c40a-4a13-ad51-890bbf63fc48", "name": "network-vif-deleted", "tag": "ff7bae65-f87f-45fd-a161-9185454b3da1"}]} {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:12:55.793299 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 05:12:55.793299 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: warnings.warn(msg) Feb 19 05:12:55.795053 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-815fedf6-1596-4566-bcf0-5abc17f6d12a tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '878e94e8d400454790f54697f9a8f9e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e9a5a891aa4f9184d68b7730fe8805', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:12:55.804739 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [req-a85e0957-1f95-4509-8401-b6afb01a0add req-f53941f1-337e-4f46-ae8f-350e75b05a16 service nova] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:12:55.805261 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [req-a85e0957-1f95-4509-8401-b6afb01a0add req-f53941f1-337e-4f46-ae8f-350e75b05a16 service nova] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:12:55.807033 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-815fedf6-1596-4566-bcf0-5abc17f6d12a tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] 10.222.0.47 "GET /compute/v2.1/servers/66b6840a-cca9-43d0-824e-2d492eb10b1d" status: 200 len: 1569 microversion: 2.1 time: 0.515974 Feb 19 05:12:55.807746 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 536/1071] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:12:55 2021] GET /compute/v2.1/servers/66b6840a-cca9-43d0-824e-2d492eb10b1d => generated 1569 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:12:55.825708 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.compute.server_external_events [req-a85e0957-1f95-4509-8401-b6afb01a0add req-f53941f1-337e-4f46-ae8f-350e75b05a16 service nova] Creating event network-vif-deleted:ff7bae65-f87f-45fd-a161-9185454b3da1 for instance 9aff0765-c40a-4a13-ad51-890bbf63fc48 on hv-cinder-77642 Feb 19 05:12:55.833315 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [req-a85e0957-1f95-4509-8401-b6afb01a0add req-f53941f1-337e-4f46-ae8f-350e75b05a16 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051955 Feb 19 05:12:55.833992 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 536/1072] 10.222.0.47 () {64 vars in 1308 bytes} [Fri Feb 19 05:12:55 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 05:12:56.794394 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-ff4f70e5-f120-4105-8366-ac0d65f925a4 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:12:56.795052 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-ff4f70e5-f120-4105-8366-ac0d65f925a4 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] [instance: 9aff0765-c40a-4a13-ad51-890bbf63fc48] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:12:56.803062 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-ff4f70e5-f120-4105-8366-ac0d65f925a4 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:12:56.803595 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-ff4f70e5-f120-4105-8366-ac0d65f925a4 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:12:56.804421 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-ff4f70e5-f120-4105-8366-ac0d65f925a4 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:12:56.804905 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-ff4f70e5-f120-4105-8366-ac0d65f925a4 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:12:56.828453 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-b42ff310-3c5c-4808-a4c4-e15f0338b391 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:12:56.829802 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-b42ff310-3c5c-4808-a4c4-e15f0338b391 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] [instance: 66b6840a-cca9-43d0-824e-2d492eb10b1d] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:12:56.838180 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-b42ff310-3c5c-4808-a4c4-e15f0338b391 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:12:56.838682 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-b42ff310-3c5c-4808-a4c4-e15f0338b391 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:12:56.839590 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-b42ff310-3c5c-4808-a4c4-e15f0338b391 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:12:56.840087 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-b42ff310-3c5c-4808-a4c4-e15f0338b391 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:12:56.879639 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-ff4f70e5-f120-4105-8366-ac0d65f925a4 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:12:56.880010 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-ff4f70e5-f120-4105-8366-ac0d65f925a4 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:12:56.880531 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.objects.instance [None req-ff4f70e5-f120-4105-8366-ac0d65f925a4 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lazy-loading 'fault' on Instance uuid 9aff0765-c40a-4a13-ad51-890bbf63fc48 {{(pid=98154) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Feb 19 05:12:56.988083 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-ff4f70e5-f120-4105-8366-ac0d65f925a4 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32f894b7dad5447688fb395e08d31d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87857a2fc3a4866a8055ed181d12edf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:12:56.997422 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-ff4f70e5-f120-4105-8366-ac0d65f925a4 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] 10.222.0.47 "GET /compute/v2.1/servers/9aff0765-c40a-4a13-ad51-890bbf63fc48" status: 200 len: 1229 microversion: 2.1 time: 0.206975 Feb 19 05:12:56.998087 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 537/1073] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:12:56 2021] GET /compute/v2.1/servers/9aff0765-c40a-4a13-ad51-890bbf63fc48 => generated 1229 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:12:57.094255 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-b42ff310-3c5c-4808-a4c4-e15f0338b391 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '878e94e8d400454790f54697f9a8f9e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e9a5a891aa4f9184d68b7730fe8805', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:12:57.104270 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-b42ff310-3c5c-4808-a4c4-e15f0338b391 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] 10.222.0.47 "GET /compute/v2.1/servers/66b6840a-cca9-43d0-824e-2d492eb10b1d" status: 200 len: 1569 microversion: 2.1 time: 0.280381 Feb 19 05:12:57.104906 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 537/1074] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:12:56 2021] GET /compute/v2.1/servers/66b6840a-cca9-43d0-824e-2d492eb10b1d => generated 1569 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 05:12:57.867924 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 19 05:12:57.868523 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: Fri Feb 19 05:12:57 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 19 05:12:58.018416 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-20200b72-032a-494f-a183-73da3296b39f tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:12:58.019037 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-20200b72-032a-494f-a183-73da3296b39f tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] [instance: 9aff0765-c40a-4a13-ad51-890bbf63fc48] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:12:58.028043 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-20200b72-032a-494f-a183-73da3296b39f tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:12:58.028546 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-20200b72-032a-494f-a183-73da3296b39f tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:12:58.029475 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-20200b72-032a-494f-a183-73da3296b39f tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:12:58.029971 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-20200b72-032a-494f-a183-73da3296b39f tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:12:58.098202 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.wsgi [None req-20200b72-032a-494f-a183-73da3296b39f tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] HTTP exception thrown: Instance 9aff0765-c40a-4a13-ad51-890bbf63fc48 could not be found. Feb 19 05:12:58.099301 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-20200b72-032a-494f-a183-73da3296b39f tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Returning 404 to user: Instance 9aff0765-c40a-4a13-ad51-890bbf63fc48 could not be found. {{(pid=98154) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 19 05:12:58.100887 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-20200b72-032a-494f-a183-73da3296b39f tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] 10.222.0.47 "GET /compute/v2.1/servers/9aff0765-c40a-4a13-ad51-890bbf63fc48" status: 404 len: 111 microversion: 2.1 time: 0.087334 Feb 19 05:12:58.101920 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 538/1075] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:12:58 2021] GET /compute/v2.1/servers/9aff0765-c40a-4a13-ad51-890bbf63fc48 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 05:12:58.127880 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-4992bf88-02a8-4bdb-a533-bd02f3b1dc2f tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:12:58.128958 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-4992bf88-02a8-4bdb-a533-bd02f3b1dc2f tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] [instance: 66b6840a-cca9-43d0-824e-2d492eb10b1d] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:12:58.145730 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-4992bf88-02a8-4bdb-a533-bd02f3b1dc2f tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:12:58.146220 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-4992bf88-02a8-4bdb-a533-bd02f3b1dc2f tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:12:58.147077 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-4992bf88-02a8-4bdb-a533-bd02f3b1dc2f tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:12:58.147616 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-4992bf88-02a8-4bdb-a533-bd02f3b1dc2f tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:12:58.433196 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-4992bf88-02a8-4bdb-a533-bd02f3b1dc2f tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '878e94e8d400454790f54697f9a8f9e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e9a5a891aa4f9184d68b7730fe8805', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:12:58.443692 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-4992bf88-02a8-4bdb-a533-bd02f3b1dc2f tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] 10.222.0.47 "GET /compute/v2.1/servers/66b6840a-cca9-43d0-824e-2d492eb10b1d" status: 200 len: 1569 microversion: 2.1 time: 0.322975 Feb 19 05:12:58.444453 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 538/1076] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:12:58 2021] GET /compute/v2.1/servers/66b6840a-cca9-43d0-824e-2d492eb10b1d => generated 1569 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:12:59.161693 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [req-05ed4133-fce3-4897-a9a8-219efa9c123b req-bc6b3dfb-e831-4623-8acc-9dc44d248a41 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66b6840a-cca9-43d0-824e-2d492eb10b1d", "name": "network-vif-unplugged", "status": "completed", "tag": "335386b1-d194-45cc-bccd-e8dfb53329a0"}]} {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:12:59.164207 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 05:12:59.164207 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: warnings.warn(msg) Feb 19 05:12:59.173726 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [req-05ed4133-fce3-4897-a9a8-219efa9c123b req-bc6b3dfb-e831-4623-8acc-9dc44d248a41 service nova] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:12:59.174217 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [req-05ed4133-fce3-4897-a9a8-219efa9c123b req-bc6b3dfb-e831-4623-8acc-9dc44d248a41 service nova] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:12:59.192652 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.compute.server_external_events [req-05ed4133-fce3-4897-a9a8-219efa9c123b req-bc6b3dfb-e831-4623-8acc-9dc44d248a41 service nova] Creating event network-vif-unplugged:335386b1-d194-45cc-bccd-e8dfb53329a0 for instance 66b6840a-cca9-43d0-824e-2d492eb10b1d on hv-cinder-77642 Feb 19 05:12:59.197907 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [req-05ed4133-fce3-4897-a9a8-219efa9c123b req-bc6b3dfb-e831-4623-8acc-9dc44d248a41 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.040993 Feb 19 05:12:59.198567 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 539/1077] 10.222.0.47 () {64 vars in 1308 bytes} [Fri Feb 19 05:12:59 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 19 05:12:59.466607 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-c33487d8-f96f-4d0b-9db9-462d7e6ac120 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:12:59.467291 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-c33487d8-f96f-4d0b-9db9-462d7e6ac120 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] [instance: 66b6840a-cca9-43d0-824e-2d492eb10b1d] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:12:59.475787 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-c33487d8-f96f-4d0b-9db9-462d7e6ac120 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:12:59.476305 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-c33487d8-f96f-4d0b-9db9-462d7e6ac120 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:12:59.477151 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-c33487d8-f96f-4d0b-9db9-462d7e6ac120 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:12:59.477644 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-c33487d8-f96f-4d0b-9db9-462d7e6ac120 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:12:59.704847 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-c33487d8-f96f-4d0b-9db9-462d7e6ac120 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '878e94e8d400454790f54697f9a8f9e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e9a5a891aa4f9184d68b7730fe8805', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:12:59.713995 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-c33487d8-f96f-4d0b-9db9-462d7e6ac120 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] 10.222.0.47 "GET /compute/v2.1/servers/66b6840a-cca9-43d0-824e-2d492eb10b1d" status: 200 len: 1510 microversion: 2.1 time: 0.252201 Feb 19 05:12:59.714629 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 539/1078] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:12:59 2021] GET /compute/v2.1/servers/66b6840a-cca9-43d0-824e-2d492eb10b1d => generated 1510 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:12:59.732828 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-ebfe31d4-e2d9-4bd5-b2d5-6708c968375c tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:12:59.733587 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-ebfe31d4-e2d9-4bd5-b2d5-6708c968375c tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] [instance: 66b6840a-cca9-43d0-824e-2d492eb10b1d] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:12:59.742362 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-ebfe31d4-e2d9-4bd5-b2d5-6708c968375c tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:12:59.742893 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-ebfe31d4-e2d9-4bd5-b2d5-6708c968375c tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:12:59.743752 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-ebfe31d4-e2d9-4bd5-b2d5-6708c968375c tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:12:59.744260 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-ebfe31d4-e2d9-4bd5-b2d5-6708c968375c tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:12:59.900539 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-ebfe31d4-e2d9-4bd5-b2d5-6708c968375c tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] 10.222.0.47 "POST /compute/v2.1/servers/66b6840a-cca9-43d0-824e-2d492eb10b1d/action" status: 202 len: 0 microversion: 2.1 time: 0.172145 Feb 19 05:12:59.901108 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 540/1079] 10.222.0.47 () {60 vars in 1268 bytes} [Fri Feb 19 05:12:59 2021] POST /compute/v2.1/servers/66b6840a-cca9-43d0-824e-2d492eb10b1d/action => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 19 05:12:59.910565 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-33b2178d-65af-4055-b6b7-8bc49db26301 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:12:59.911239 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-33b2178d-65af-4055-b6b7-8bc49db26301 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] [instance: 66b6840a-cca9-43d0-824e-2d492eb10b1d] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:12:59.919131 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-33b2178d-65af-4055-b6b7-8bc49db26301 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:12:59.919673 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-33b2178d-65af-4055-b6b7-8bc49db26301 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:12:59.920526 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-33b2178d-65af-4055-b6b7-8bc49db26301 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:12:59.921015 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-33b2178d-65af-4055-b6b7-8bc49db26301 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:13:00.144410 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-33b2178d-65af-4055-b6b7-8bc49db26301 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '878e94e8d400454790f54697f9a8f9e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e9a5a891aa4f9184d68b7730fe8805', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:13:00.153700 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-33b2178d-65af-4055-b6b7-8bc49db26301 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] 10.222.0.47 "GET /compute/v2.1/servers/66b6840a-cca9-43d0-824e-2d492eb10b1d" status: 200 len: 1518 microversion: 2.1 time: 0.248001 Feb 19 05:13:00.154353 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 540/1080] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:12:59 2021] GET /compute/v2.1/servers/66b6840a-cca9-43d0-824e-2d492eb10b1d => generated 1518 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:13:00.625898 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-1f7806e7-f36f-48c8-ba9a-fa2ff48f1bc3 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Calling method '.version_select at 0x7f270723bf28>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:13:01.172576 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-61b9493f-8e12-4874-96ac-7688bb41dbdb tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:13:01.173814 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-61b9493f-8e12-4874-96ac-7688bb41dbdb tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] [instance: 66b6840a-cca9-43d0-824e-2d492eb10b1d] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:13:01.179994 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-1f7806e7-f36f-48c8-ba9a-fa2ff48f1bc3 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] [instance: 9a73fc48-03e5-457a-9ca7-a88320b99dea] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:13:01.181801 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-61b9493f-8e12-4874-96ac-7688bb41dbdb tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:13:01.182317 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-61b9493f-8e12-4874-96ac-7688bb41dbdb tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:13:01.183149 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-61b9493f-8e12-4874-96ac-7688bb41dbdb tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:13:01.183865 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-61b9493f-8e12-4874-96ac-7688bb41dbdb tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:13:01.188461 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-1f7806e7-f36f-48c8-ba9a-fa2ff48f1bc3 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:13:01.189841 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-1f7806e7-f36f-48c8-ba9a-fa2ff48f1bc3 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:13:01.190809 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-1f7806e7-f36f-48c8-ba9a-fa2ff48f1bc3 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:13:01.191307 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-1f7806e7-f36f-48c8-ba9a-fa2ff48f1bc3 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:13:01.256622 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-1f7806e7-f36f-48c8-ba9a-fa2ff48f1bc3 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Acquired lock "refresh_cache-9a73fc48-03e5-457a-9ca7-a88320b99dea" {{(pid=98154) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:266}} Feb 19 05:13:02.107081 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-61b9493f-8e12-4874-96ac-7688bb41dbdb tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '878e94e8d400454790f54697f9a8f9e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e9a5a891aa4f9184d68b7730fe8805', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:13:02.117164 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-61b9493f-8e12-4874-96ac-7688bb41dbdb tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] 10.222.0.47 "GET /compute/v2.1/servers/66b6840a-cca9-43d0-824e-2d492eb10b1d" status: 200 len: 1520 microversion: 2.1 time: 0.948463 Feb 19 05:13:02.117645 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 541/1081] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:13:01 2021] GET /compute/v2.1/servers/66b6840a-cca9-43d0-824e-2d492eb10b1d => generated 1520 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:13:03.136363 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-946a459f-de5d-4b15-9678-62d674c83968 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:13:03.137041 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-946a459f-de5d-4b15-9678-62d674c83968 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] [instance: 66b6840a-cca9-43d0-824e-2d492eb10b1d] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:13:03.146707 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-946a459f-de5d-4b15-9678-62d674c83968 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:13:03.147224 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-946a459f-de5d-4b15-9678-62d674c83968 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:13:03.148222 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-946a459f-de5d-4b15-9678-62d674c83968 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:13:03.148809 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-946a459f-de5d-4b15-9678-62d674c83968 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:13:04.089823 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-946a459f-de5d-4b15-9678-62d674c83968 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '878e94e8d400454790f54697f9a8f9e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e9a5a891aa4f9184d68b7730fe8805', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:13:04.100538 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-946a459f-de5d-4b15-9678-62d674c83968 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] 10.222.0.47 "GET /compute/v2.1/servers/66b6840a-cca9-43d0-824e-2d492eb10b1d" status: 200 len: 1520 microversion: 2.1 time: 0.969143 Feb 19 05:13:04.101552 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 542/1082] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:13:03 2021] GET /compute/v2.1/servers/66b6840a-cca9-43d0-824e-2d492eb10b1d => generated 1520 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 05:13:04.435859 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.network.neutron [None req-1f7806e7-f36f-48c8-ba9a-fa2ff48f1bc3 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] [instance: 9a73fc48-03e5-457a-9ca7-a88320b99dea] Building network info cache for instance {{(pid=98154) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1836}} Feb 19 05:13:04.445136 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [req-ab37f53e-b050-4f0d-9b47-3e0b09030b33 req-ae81f32e-8405-4309-bf2c-50667e79f3f2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9a73fc48-03e5-457a-9ca7-a88320b99dea", "tag": "40c60130-4312-40cf-8192-b2d69af35fa4"}]} {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:13:04.446759 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 05:13:04.446759 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: warnings.warn(msg) Feb 19 05:13:04.463601 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [req-ab37f53e-b050-4f0d-9b47-3e0b09030b33 req-ae81f32e-8405-4309-bf2c-50667e79f3f2 service nova] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:13:04.464102 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [req-ab37f53e-b050-4f0d-9b47-3e0b09030b33 req-ae81f32e-8405-4309-bf2c-50667e79f3f2 service nova] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:13:04.482050 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.compute.server_external_events [req-ab37f53e-b050-4f0d-9b47-3e0b09030b33 req-ae81f32e-8405-4309-bf2c-50667e79f3f2 service nova] Creating event network-changed:40c60130-4312-40cf-8192-b2d69af35fa4 for instance 9a73fc48-03e5-457a-9ca7-a88320b99dea on hv-cinder-77642 Feb 19 05:13:04.487549 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [req-ab37f53e-b050-4f0d-9b47-3e0b09030b33 req-ae81f32e-8405-4309-bf2c-50667e79f3f2 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046213 Feb 19 05:13:04.488511 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 543/1083] 10.222.0.47 () {64 vars in 1308 bytes} [Fri Feb 19 05:13:04 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 05:13:05.121523 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-80a39e58-5bce-4cdb-9dc9-d8541d786a96 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:13:05.121523 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-80a39e58-5bce-4cdb-9dc9-d8541d786a96 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] [instance: 66b6840a-cca9-43d0-824e-2d492eb10b1d] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:13:05.130376 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-80a39e58-5bce-4cdb-9dc9-d8541d786a96 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:13:05.130983 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-80a39e58-5bce-4cdb-9dc9-d8541d786a96 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:13:05.132056 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-80a39e58-5bce-4cdb-9dc9-d8541d786a96 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:13:05.132541 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-80a39e58-5bce-4cdb-9dc9-d8541d786a96 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:13:05.623202 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-80a39e58-5bce-4cdb-9dc9-d8541d786a96 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '878e94e8d400454790f54697f9a8f9e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e9a5a891aa4f9184d68b7730fe8805', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:13:05.632751 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-80a39e58-5bce-4cdb-9dc9-d8541d786a96 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] 10.222.0.47 "GET /compute/v2.1/servers/66b6840a-cca9-43d0-824e-2d492eb10b1d" status: 200 len: 1576 microversion: 2.1 time: 0.516534 Feb 19 05:13:05.633492 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 544/1084] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:13:05 2021] GET /compute/v2.1/servers/66b6840a-cca9-43d0-824e-2d492eb10b1d => generated 1576 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:13:06.123293 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.network.neutron [None req-1f7806e7-f36f-48c8-ba9a-fa2ff48f1bc3 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] [instance: 9a73fc48-03e5-457a-9ca7-a88320b99dea] Updating instance_info_cache with network_info: [{"id": "40c60130-4312-40cf-8192-b2d69af35fa4", "address": "fa:16:3e:9f:22:86", "network": {"id": "68c8736e-693c-40d6-962b-ec56c71786c4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-815410707-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "f87857a2fc3a4866a8055ed181d12edf", "mtu": 1450, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, "devname": "tap40c60130-43", "ovs_interfaceid": "40c60130-4312-40cf-8192-b2d69af35fa4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "meta": {}}] {{(pid=98154) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Feb 19 05:13:06.134346 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-1f7806e7-f36f-48c8-ba9a-fa2ff48f1bc3 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Releasing lock "refresh_cache-9a73fc48-03e5-457a-9ca7-a88320b99dea" {{(pid=98154) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:282}} Feb 19 05:13:06.135310 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-1f7806e7-f36f-48c8-ba9a-fa2ff48f1bc3 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] 10.222.0.47 "DELETE /compute/v2.1/os-floating-ips/2c56e3fe-05c2-4270-9481-24cf95e45ebe" status: 202 len: 0 microversion: 2.1 time: 5.514196 Feb 19 05:13:06.135989 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 541/1085] 10.222.0.47 () {58 vars in 1253 bytes} [Fri Feb 19 05:13:00 2021] DELETE /compute/v2.1/os-floating-ips/2c56e3fe-05c2-4270-9481-24cf95e45ebe => generated 0 bytes in 5516 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 19 05:13:06.145736 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-3cf90d90-e355-40fd-bd8c-0302276c7a3d tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:13:06.146387 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-3cf90d90-e355-40fd-bd8c-0302276c7a3d tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] [instance: 9a73fc48-03e5-457a-9ca7-a88320b99dea] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:13:06.154395 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-3cf90d90-e355-40fd-bd8c-0302276c7a3d tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:13:06.154902 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-3cf90d90-e355-40fd-bd8c-0302276c7a3d tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:13:06.155877 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-3cf90d90-e355-40fd-bd8c-0302276c7a3d tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:13:06.156371 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-3cf90d90-e355-40fd-bd8c-0302276c7a3d tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:13:06.225461 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-3cf90d90-e355-40fd-bd8c-0302276c7a3d tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] [instance: 9a73fc48-03e5-457a-9ca7-a88320b99dea] Going to try to terminate instance {{(pid=98153) delete /opt/stack/nova/nova/compute/api.py:2540}} Feb 19 05:13:06.342745 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-3cf90d90-e355-40fd-bd8c-0302276c7a3d tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] 10.222.0.47 "DELETE /compute/v2.1/servers/9a73fc48-03e5-457a-9ca7-a88320b99dea" status: 204 len: 0 microversion: 2.1 time: 0.201555 Feb 19 05:13:06.343663 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 545/1086] 10.222.0.47 () {58 vars in 1229 bytes} [Fri Feb 19 05:13:06 2021] DELETE /compute/v2.1/servers/9a73fc48-03e5-457a-9ca7-a88320b99dea => generated 0 bytes in 203 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 19 05:13:06.352675 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-eefecf22-69fd-4374-80e5-5efa858294e1 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:13:06.353344 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-eefecf22-69fd-4374-80e5-5efa858294e1 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] [instance: 9a73fc48-03e5-457a-9ca7-a88320b99dea] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:13:06.361359 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-eefecf22-69fd-4374-80e5-5efa858294e1 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:13:06.361873 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-eefecf22-69fd-4374-80e5-5efa858294e1 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:13:06.362715 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-eefecf22-69fd-4374-80e5-5efa858294e1 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:13:06.363200 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-eefecf22-69fd-4374-80e5-5efa858294e1 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:13:06.594187 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-eefecf22-69fd-4374-80e5-5efa858294e1 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32f894b7dad5447688fb395e08d31d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87857a2fc3a4866a8055ed181d12edf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:13:06.603473 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-eefecf22-69fd-4374-80e5-5efa858294e1 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] 10.222.0.47 "GET /compute/v2.1/servers/9a73fc48-03e5-457a-9ca7-a88320b99dea" status: 200 len: 1466 microversion: 2.1 time: 0.254686 Feb 19 05:13:06.603984 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 542/1087] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:13:06 2021] GET /compute/v2.1/servers/9a73fc48-03e5-457a-9ca7-a88320b99dea => generated 1466 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 05:13:06.653030 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-2034d09f-9ea8-4ae9-a741-46651b9df98e tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:13:06.653846 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-2034d09f-9ea8-4ae9-a741-46651b9df98e tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] [instance: 66b6840a-cca9-43d0-824e-2d492eb10b1d] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:13:06.661983 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-2034d09f-9ea8-4ae9-a741-46651b9df98e tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:13:06.662483 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-2034d09f-9ea8-4ae9-a741-46651b9df98e tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:13:06.663314 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-2034d09f-9ea8-4ae9-a741-46651b9df98e tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:13:06.663823 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-2034d09f-9ea8-4ae9-a741-46651b9df98e tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:13:06.878367 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-2034d09f-9ea8-4ae9-a741-46651b9df98e tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '878e94e8d400454790f54697f9a8f9e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e9a5a891aa4f9184d68b7730fe8805', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:13:06.887287 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-2034d09f-9ea8-4ae9-a741-46651b9df98e tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] 10.222.0.47 "GET /compute/v2.1/servers/66b6840a-cca9-43d0-824e-2d492eb10b1d" status: 200 len: 1576 microversion: 2.1 time: 0.238799 Feb 19 05:13:06.887942 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 546/1088] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:13:06 2021] GET /compute/v2.1/servers/66b6840a-cca9-43d0-824e-2d492eb10b1d => generated 1576 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:13:07.622905 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-b8090141-bf21-460b-aa4c-dfd29169d1c6 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:13:07.623623 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-b8090141-bf21-460b-aa4c-dfd29169d1c6 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] [instance: 9a73fc48-03e5-457a-9ca7-a88320b99dea] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:13:07.631644 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-b8090141-bf21-460b-aa4c-dfd29169d1c6 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:13:07.632151 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-b8090141-bf21-460b-aa4c-dfd29169d1c6 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:13:07.632989 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-b8090141-bf21-460b-aa4c-dfd29169d1c6 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:13:07.633483 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-b8090141-bf21-460b-aa4c-dfd29169d1c6 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:13:07.851675 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-b8090141-bf21-460b-aa4c-dfd29169d1c6 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32f894b7dad5447688fb395e08d31d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87857a2fc3a4866a8055ed181d12edf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:13:07.861343 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-b8090141-bf21-460b-aa4c-dfd29169d1c6 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] 10.222.0.47 "GET /compute/v2.1/servers/9a73fc48-03e5-457a-9ca7-a88320b99dea" status: 200 len: 1466 microversion: 2.1 time: 0.243097 Feb 19 05:13:07.861971 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 543/1089] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:13:07 2021] GET /compute/v2.1/servers/9a73fc48-03e5-457a-9ca7-a88320b99dea => generated 1466 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:13:07.905753 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-4d6b2110-19ed-4c27-84eb-841301208431 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:13:07.906369 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-4d6b2110-19ed-4c27-84eb-841301208431 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] [instance: 66b6840a-cca9-43d0-824e-2d492eb10b1d] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:13:07.914738 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-4d6b2110-19ed-4c27-84eb-841301208431 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:13:07.915250 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-4d6b2110-19ed-4c27-84eb-841301208431 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:13:07.916115 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-4d6b2110-19ed-4c27-84eb-841301208431 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:13:07.916606 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-4d6b2110-19ed-4c27-84eb-841301208431 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:13:08.132809 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-4d6b2110-19ed-4c27-84eb-841301208431 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '878e94e8d400454790f54697f9a8f9e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e9a5a891aa4f9184d68b7730fe8805', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:13:08.142800 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-4d6b2110-19ed-4c27-84eb-841301208431 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] 10.222.0.47 "GET /compute/v2.1/servers/66b6840a-cca9-43d0-824e-2d492eb10b1d" status: 200 len: 1576 microversion: 2.1 time: 0.241066 Feb 19 05:13:08.143447 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 547/1090] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:13:07 2021] GET /compute/v2.1/servers/66b6840a-cca9-43d0-824e-2d492eb10b1d => generated 1576 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:13:08.879900 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-7d84daf6-b28e-4b0b-8a2c-840de0532335 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:13:08.880470 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-7d84daf6-b28e-4b0b-8a2c-840de0532335 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] [instance: 9a73fc48-03e5-457a-9ca7-a88320b99dea] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:13:08.888505 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-7d84daf6-b28e-4b0b-8a2c-840de0532335 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:13:08.889020 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-7d84daf6-b28e-4b0b-8a2c-840de0532335 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:13:08.890171 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-7d84daf6-b28e-4b0b-8a2c-840de0532335 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:13:08.890794 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-7d84daf6-b28e-4b0b-8a2c-840de0532335 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:13:09.161723 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-c8fc580b-cf3a-4ed5-aba2-60987789a0b2 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:13:09.162691 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-c8fc580b-cf3a-4ed5-aba2-60987789a0b2 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] [instance: 66b6840a-cca9-43d0-824e-2d492eb10b1d] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:13:09.170914 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-c8fc580b-cf3a-4ed5-aba2-60987789a0b2 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:13:09.171453 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-c8fc580b-cf3a-4ed5-aba2-60987789a0b2 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:13:09.172484 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-c8fc580b-cf3a-4ed5-aba2-60987789a0b2 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:13:09.173735 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-c8fc580b-cf3a-4ed5-aba2-60987789a0b2 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:13:09.392145 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-7d84daf6-b28e-4b0b-8a2c-840de0532335 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32f894b7dad5447688fb395e08d31d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87857a2fc3a4866a8055ed181d12edf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:13:09.407008 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-7d84daf6-b28e-4b0b-8a2c-840de0532335 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] 10.222.0.47 "GET /compute/v2.1/servers/9a73fc48-03e5-457a-9ca7-a88320b99dea" status: 200 len: 1466 microversion: 2.1 time: 0.531016 Feb 19 05:13:09.418305 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 544/1091] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:13:08 2021] GET /compute/v2.1/servers/9a73fc48-03e5-457a-9ca7-a88320b99dea => generated 1466 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 05:13:09.635700 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-c8fc580b-cf3a-4ed5-aba2-60987789a0b2 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '878e94e8d400454790f54697f9a8f9e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e9a5a891aa4f9184d68b7730fe8805', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:13:09.646697 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-c8fc580b-cf3a-4ed5-aba2-60987789a0b2 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] 10.222.0.47 "GET /compute/v2.1/servers/66b6840a-cca9-43d0-824e-2d492eb10b1d" status: 200 len: 1576 microversion: 2.1 time: 0.489626 Feb 19 05:13:09.657516 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 548/1092] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:13:09 2021] GET /compute/v2.1/servers/66b6840a-cca9-43d0-824e-2d492eb10b1d => generated 1576 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 05:13:09.698662 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [req-a0e006c7-32e3-4553-813f-a796b64855de req-2b2c5185-a9db-4c5f-9e6a-84f537bd0c7f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a73fc48-03e5-457a-9ca7-a88320b99dea", "name": "network-vif-deleted", "tag": "40c60130-4312-40cf-8192-b2d69af35fa4"}]} {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:13:09.700629 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 05:13:09.700629 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: warnings.warn(msg) Feb 19 05:13:09.711051 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [req-a0e006c7-32e3-4553-813f-a796b64855de req-2b2c5185-a9db-4c5f-9e6a-84f537bd0c7f service nova] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:13:09.711684 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [req-a0e006c7-32e3-4553-813f-a796b64855de req-2b2c5185-a9db-4c5f-9e6a-84f537bd0c7f service nova] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:13:09.729692 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.compute.server_external_events [req-a0e006c7-32e3-4553-813f-a796b64855de req-2b2c5185-a9db-4c5f-9e6a-84f537bd0c7f service nova] Creating event network-vif-deleted:40c60130-4312-40cf-8192-b2d69af35fa4 for instance 9a73fc48-03e5-457a-9ca7-a88320b99dea on hv-cinder-77642 Feb 19 05:13:09.734599 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [req-a0e006c7-32e3-4553-813f-a796b64855de req-2b2c5185-a9db-4c5f-9e6a-84f537bd0c7f service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039919 Feb 19 05:13:09.735279 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 545/1093] 10.222.0.47 () {64 vars in 1308 bytes} [Fri Feb 19 05:13:09 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 05:13:10.427077 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-601a7b43-19ee-4b8c-a297-44baedeaf8f0 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:13:10.427801 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-601a7b43-19ee-4b8c-a297-44baedeaf8f0 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] [instance: 9a73fc48-03e5-457a-9ca7-a88320b99dea] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:13:10.435850 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-601a7b43-19ee-4b8c-a297-44baedeaf8f0 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:13:10.436367 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-601a7b43-19ee-4b8c-a297-44baedeaf8f0 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:13:10.437214 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-601a7b43-19ee-4b8c-a297-44baedeaf8f0 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:13:10.437719 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-601a7b43-19ee-4b8c-a297-44baedeaf8f0 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:13:10.511877 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-601a7b43-19ee-4b8c-a297-44baedeaf8f0 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:13:10.512318 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-601a7b43-19ee-4b8c-a297-44baedeaf8f0 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:13:10.512825 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.objects.instance [None req-601a7b43-19ee-4b8c-a297-44baedeaf8f0 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lazy-loading 'fault' on Instance uuid 9a73fc48-03e5-457a-9ca7-a88320b99dea {{(pid=98153) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Feb 19 05:13:10.597829 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-601a7b43-19ee-4b8c-a297-44baedeaf8f0 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32f894b7dad5447688fb395e08d31d4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87857a2fc3a4866a8055ed181d12edf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:13:10.606692 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-601a7b43-19ee-4b8c-a297-44baedeaf8f0 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] 10.222.0.47 "GET /compute/v2.1/servers/9a73fc48-03e5-457a-9ca7-a88320b99dea" status: 200 len: 1230 microversion: 2.1 time: 0.184657 Feb 19 05:13:10.608173 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 549/1094] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:13:10 2021] GET /compute/v2.1/servers/9a73fc48-03e5-457a-9ca7-a88320b99dea => generated 1230 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:13:10.666463 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-e8dfb4c0-8234-48ca-9e9e-a8cb513032e4 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:13:10.667240 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-e8dfb4c0-8234-48ca-9e9e-a8cb513032e4 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] [instance: 66b6840a-cca9-43d0-824e-2d492eb10b1d] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:13:10.675540 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-e8dfb4c0-8234-48ca-9e9e-a8cb513032e4 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:13:10.676053 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-e8dfb4c0-8234-48ca-9e9e-a8cb513032e4 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:13:10.676893 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-e8dfb4c0-8234-48ca-9e9e-a8cb513032e4 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:13:10.677384 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-e8dfb4c0-8234-48ca-9e9e-a8cb513032e4 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:13:10.898088 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-e8dfb4c0-8234-48ca-9e9e-a8cb513032e4 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '878e94e8d400454790f54697f9a8f9e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e9a5a891aa4f9184d68b7730fe8805', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:13:10.907776 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-e8dfb4c0-8234-48ca-9e9e-a8cb513032e4 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] 10.222.0.47 "GET /compute/v2.1/servers/66b6840a-cca9-43d0-824e-2d492eb10b1d" status: 200 len: 1576 microversion: 2.1 time: 0.245583 Feb 19 05:13:10.908109 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 546/1095] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:13:10 2021] GET /compute/v2.1/servers/66b6840a-cca9-43d0-824e-2d492eb10b1d => generated 1576 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:13:11.626435 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-48eea052-3994-4b2f-9bce-5e5bd26a0915 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:13:11.627268 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-48eea052-3994-4b2f-9bce-5e5bd26a0915 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] [instance: 9a73fc48-03e5-457a-9ca7-a88320b99dea] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:13:11.635615 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-48eea052-3994-4b2f-9bce-5e5bd26a0915 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:13:11.636129 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-48eea052-3994-4b2f-9bce-5e5bd26a0915 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:13:11.636980 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-48eea052-3994-4b2f-9bce-5e5bd26a0915 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:13:11.637484 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-48eea052-3994-4b2f-9bce-5e5bd26a0915 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:13:11.693300 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.wsgi [None req-48eea052-3994-4b2f-9bce-5e5bd26a0915 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] HTTP exception thrown: Instance 9a73fc48-03e5-457a-9ca7-a88320b99dea could not be found. Feb 19 05:13:11.693981 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-48eea052-3994-4b2f-9bce-5e5bd26a0915 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Returning 404 to user: Instance 9a73fc48-03e5-457a-9ca7-a88320b99dea could not be found. {{(pid=98153) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 19 05:13:11.694903 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-48eea052-3994-4b2f-9bce-5e5bd26a0915 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] 10.222.0.47 "GET /compute/v2.1/servers/9a73fc48-03e5-457a-9ca7-a88320b99dea" status: 404 len: 111 microversion: 2.1 time: 0.072912 Feb 19 05:13:11.695577 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 550/1096] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:13:11 2021] GET /compute/v2.1/servers/9a73fc48-03e5-457a-9ca7-a88320b99dea => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 05:13:11.705278 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-5e663ecd-c49e-4e12-87d3-f447441eaffd tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Calling method '.version_select at 0x7f27083e3378>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:13:11.925825 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-f9e67dca-95ae-4d33-a6dd-10a27df64545 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:13:11.926476 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-f9e67dca-95ae-4d33-a6dd-10a27df64545 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] [instance: 66b6840a-cca9-43d0-824e-2d492eb10b1d] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:13:11.934794 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-f9e67dca-95ae-4d33-a6dd-10a27df64545 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:13:11.935360 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-f9e67dca-95ae-4d33-a6dd-10a27df64545 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:13:11.936231 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-f9e67dca-95ae-4d33-a6dd-10a27df64545 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:13:11.936721 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-f9e67dca-95ae-4d33-a6dd-10a27df64545 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:13:12.430861 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-f9e67dca-95ae-4d33-a6dd-10a27df64545 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '878e94e8d400454790f54697f9a8f9e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e9a5a891aa4f9184d68b7730fe8805', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:13:12.440920 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-f9e67dca-95ae-4d33-a6dd-10a27df64545 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] 10.222.0.47 "GET /compute/v2.1/servers/66b6840a-cca9-43d0-824e-2d492eb10b1d" status: 200 len: 1576 microversion: 2.1 time: 0.519299 Feb 19 05:13:12.441750 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 551/1097] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:13:11 2021] GET /compute/v2.1/servers/66b6840a-cca9-43d0-824e-2d492eb10b1d => generated 1576 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:13:13.425709 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-5e663ecd-c49e-4e12-87d3-f447441eaffd tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] 10.222.0.47 "DELETE /compute/v2.1/os-floating-ips/60cdb5f5-7379-437d-ade0-4b5cd91761b4" status: 202 len: 0 microversion: 2.1 time: 1.725096 Feb 19 05:13:13.426360 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 547/1098] 10.222.0.47 () {58 vars in 1253 bytes} [Fri Feb 19 05:13:11 2021] DELETE /compute/v2.1/os-floating-ips/60cdb5f5-7379-437d-ade0-4b5cd91761b4 => generated 0 bytes in 1727 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 19 05:13:13.435161 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-bd67b5e3-a98e-4d30-940a-8b36a42e42f4 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:13:13.435738 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-bd67b5e3-a98e-4d30-940a-8b36a42e42f4 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] [instance: 309f67c8-0c6b-44ba-8084-7af7e889fb60] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:13:13.443669 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-bd67b5e3-a98e-4d30-940a-8b36a42e42f4 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:13:13.444180 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-bd67b5e3-a98e-4d30-940a-8b36a42e42f4 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:13:13.445017 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-bd67b5e3-a98e-4d30-940a-8b36a42e42f4 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:13:13.445510 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-bd67b5e3-a98e-4d30-940a-8b36a42e42f4 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:13:13.459517 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-6b82d9eb-f471-4e14-a1ca-71dc5c5b3844 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:13:13.460308 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-6b82d9eb-f471-4e14-a1ca-71dc5c5b3844 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] [instance: 66b6840a-cca9-43d0-824e-2d492eb10b1d] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:13:13.468337 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-6b82d9eb-f471-4e14-a1ca-71dc5c5b3844 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:13:13.468955 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-6b82d9eb-f471-4e14-a1ca-71dc5c5b3844 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:13:13.470614 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-6b82d9eb-f471-4e14-a1ca-71dc5c5b3844 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:13:13.471180 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-6b82d9eb-f471-4e14-a1ca-71dc5c5b3844 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:13:13.499388 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.wsgi [None req-bd67b5e3-a98e-4d30-940a-8b36a42e42f4 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] HTTP exception thrown: Instance 309f67c8-0c6b-44ba-8084-7af7e889fb60 could not be found. Feb 19 05:13:13.500087 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-bd67b5e3-a98e-4d30-940a-8b36a42e42f4 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Returning 404 to user: Instance 309f67c8-0c6b-44ba-8084-7af7e889fb60 could not be found. {{(pid=98153) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 19 05:13:13.501042 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-bd67b5e3-a98e-4d30-940a-8b36a42e42f4 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] 10.222.0.47 "DELETE /compute/v2.1/servers/309f67c8-0c6b-44ba-8084-7af7e889fb60" status: 404 len: 111 microversion: 2.1 time: 0.069946 Feb 19 05:13:13.501671 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 552/1099] 10.222.0.47 () {58 vars in 1229 bytes} [Fri Feb 19 05:13:13 2021] DELETE /compute/v2.1/servers/309f67c8-0c6b-44ba-8084-7af7e889fb60 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 05:13:13.510033 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-19ea4371-d2cd-4fb0-a1da-32e42ed59ef7 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:13:13.510706 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-19ea4371-d2cd-4fb0-a1da-32e42ed59ef7 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] [instance: 309f67c8-0c6b-44ba-8084-7af7e889fb60] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:13:13.518646 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-19ea4371-d2cd-4fb0-a1da-32e42ed59ef7 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:13:13.519156 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-19ea4371-d2cd-4fb0-a1da-32e42ed59ef7 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:13:13.520053 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-19ea4371-d2cd-4fb0-a1da-32e42ed59ef7 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:13:13.520548 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-19ea4371-d2cd-4fb0-a1da-32e42ed59ef7 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:13:13.573872 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.wsgi [None req-19ea4371-d2cd-4fb0-a1da-32e42ed59ef7 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] HTTP exception thrown: Instance 309f67c8-0c6b-44ba-8084-7af7e889fb60 could not be found. Feb 19 05:13:13.574539 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-19ea4371-d2cd-4fb0-a1da-32e42ed59ef7 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Returning 404 to user: Instance 309f67c8-0c6b-44ba-8084-7af7e889fb60 could not be found. {{(pid=98153) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 19 05:13:13.575499 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-19ea4371-d2cd-4fb0-a1da-32e42ed59ef7 tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] 10.222.0.47 "GET /compute/v2.1/servers/309f67c8-0c6b-44ba-8084-7af7e889fb60" status: 404 len: 111 microversion: 2.1 time: 0.069212 Feb 19 05:13:13.576127 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 553/1100] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:13:13 2021] GET /compute/v2.1/servers/309f67c8-0c6b-44ba-8084-7af7e889fb60 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Feb 19 05:13:13.692289 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-6b82d9eb-f471-4e14-a1ca-71dc5c5b3844 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '878e94e8d400454790f54697f9a8f9e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e9a5a891aa4f9184d68b7730fe8805', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:13:13.702922 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-6b82d9eb-f471-4e14-a1ca-71dc5c5b3844 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] 10.222.0.47 "GET /compute/v2.1/servers/66b6840a-cca9-43d0-824e-2d492eb10b1d" status: 200 len: 1576 microversion: 2.1 time: 0.247181 Feb 19 05:13:13.703636 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 548/1101] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:13:13 2021] GET /compute/v2.1/servers/66b6840a-cca9-43d0-824e-2d492eb10b1d => generated 1576 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:13:13.913314 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [req-bcda8c32-3fee-472b-b0ac-dd9b8ceca7f7 req-10de5655-7c1c-4b24-ae11-b66ceb05e520 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66b6840a-cca9-43d0-824e-2d492eb10b1d", "name": "network-vif-plugged", "status": "completed", "tag": "335386b1-d194-45cc-bccd-e8dfb53329a0"}]} {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:13:13.914962 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 05:13:13.914962 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: warnings.warn(msg) Feb 19 05:13:13.923989 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [req-bcda8c32-3fee-472b-b0ac-dd9b8ceca7f7 req-10de5655-7c1c-4b24-ae11-b66ceb05e520 service nova] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:13:13.924482 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [req-bcda8c32-3fee-472b-b0ac-dd9b8ceca7f7 req-10de5655-7c1c-4b24-ae11-b66ceb05e520 service nova] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:13:13.942913 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.compute.server_external_events [req-bcda8c32-3fee-472b-b0ac-dd9b8ceca7f7 req-10de5655-7c1c-4b24-ae11-b66ceb05e520 service nova] Creating event network-vif-plugged:335386b1-d194-45cc-bccd-e8dfb53329a0 for instance 66b6840a-cca9-43d0-824e-2d492eb10b1d on hv-cinder-77642 Feb 19 05:13:13.948314 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [req-bcda8c32-3fee-472b-b0ac-dd9b8ceca7f7 req-10de5655-7c1c-4b24-ae11-b66ceb05e520 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039221 Feb 19 05:13:13.949119 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 554/1102] 10.222.0.47 () {64 vars in 1308 bytes} [Fri Feb 19 05:13:13 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 05:13:14.722123 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-598e3099-566f-4126-8d4d-db3ba4e3404d tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:13:14.722676 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-598e3099-566f-4126-8d4d-db3ba4e3404d tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] [instance: 66b6840a-cca9-43d0-824e-2d492eb10b1d] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:13:14.730795 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-598e3099-566f-4126-8d4d-db3ba4e3404d tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:13:14.731298 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-598e3099-566f-4126-8d4d-db3ba4e3404d tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:13:14.732173 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-598e3099-566f-4126-8d4d-db3ba4e3404d tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:13:14.732663 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-598e3099-566f-4126-8d4d-db3ba4e3404d tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:13:14.837838 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-5360c336-b9a9-4b59-bd5e-07243f07156a tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Calling method '.version_select at 0x7f270bb486a8>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:13:15.043919 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-598e3099-566f-4126-8d4d-db3ba4e3404d tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '878e94e8d400454790f54697f9a8f9e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e9a5a891aa4f9184d68b7730fe8805', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:13:15.053229 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-598e3099-566f-4126-8d4d-db3ba4e3404d tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] 10.222.0.47 "GET /compute/v2.1/servers/66b6840a-cca9-43d0-824e-2d492eb10b1d" status: 200 len: 1576 microversion: 2.1 time: 0.335250 Feb 19 05:13:15.053888 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 549/1103] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:13:14 2021] GET /compute/v2.1/servers/66b6840a-cca9-43d0-824e-2d492eb10b1d => generated 1576 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:13:15.160989 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-5360c336-b9a9-4b59-bd5e-07243f07156a tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] 10.222.0.47 "DELETE /compute/v2.1/os-security-groups/c724db31-0d22-4619-9a65-6958d0e05594" status: 202 len: 0 microversion: 2.1 time: 0.327622 Feb 19 05:13:15.161838 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 555/1104] 10.222.0.47 () {58 vars in 1262 bytes} [Fri Feb 19 05:13:14 2021] DELETE /compute/v2.1/os-security-groups/c724db31-0d22-4619-9a65-6958d0e05594 => generated 0 bytes in 329 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 19 05:13:15.170098 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-e41875ba-4fb9-441e-9cc5-4fb12752a81f tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] Calling method '.version_select at 0x7f27067f0598>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:13:15.191572 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-e41875ba-4fb9-441e-9cc5-4fb12752a81f tempest-TestVolumeBootPattern-746038273 tempest-TestVolumeBootPattern-746038273-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1012313419" status: 202 len: 0 microversion: 2.1 time: 0.025324 Feb 19 05:13:15.192202 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 550/1105] 10.222.0.47 () {58 vars in 1253 bytes} [Fri Feb 19 05:13:15 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1012313419 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 19 05:13:16.073053 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-c7584284-bd93-4e9e-9d61-a2515805a5c0 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:13:16.073929 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-c7584284-bd93-4e9e-9d61-a2515805a5c0 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] [instance: 66b6840a-cca9-43d0-824e-2d492eb10b1d] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:13:16.083320 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-c7584284-bd93-4e9e-9d61-a2515805a5c0 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:13:16.083858 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-c7584284-bd93-4e9e-9d61-a2515805a5c0 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:13:16.084734 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-c7584284-bd93-4e9e-9d61-a2515805a5c0 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:13:16.085228 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-c7584284-bd93-4e9e-9d61-a2515805a5c0 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:13:16.312464 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-c7584284-bd93-4e9e-9d61-a2515805a5c0 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '878e94e8d400454790f54697f9a8f9e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e9a5a891aa4f9184d68b7730fe8805', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:13:16.322622 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-c7584284-bd93-4e9e-9d61-a2515805a5c0 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] 10.222.0.47 "GET /compute/v2.1/servers/66b6840a-cca9-43d0-824e-2d492eb10b1d" status: 200 len: 1563 microversion: 2.1 time: 0.253794 Feb 19 05:13:16.323403 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 556/1106] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:13:16 2021] GET /compute/v2.1/servers/66b6840a-cca9-43d0-824e-2d492eb10b1d => generated 1563 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:14:32.519398 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: ERROR oslo.messaging._drivers.impl_rabbit [-] [deb0cc63-ccce-4796-b291-4054c1534647] AMQP server on 10.222.0.47:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Feb 19 05:14:32.522919 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-4595ef19-ebca-4377-bd68-5717388b7a33 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Calling method '.version_select at 0x7f27064fdf28>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:14:33.310007 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-4595ef19-ebca-4377-bd68-5717388b7a33 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] [instance: 66b6840a-cca9-43d0-824e-2d492eb10b1d] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:14:33.318040 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-4595ef19-ebca-4377-bd68-5717388b7a33 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:14:33.318544 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-4595ef19-ebca-4377-bd68-5717388b7a33 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:14:33.319404 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-4595ef19-ebca-4377-bd68-5717388b7a33 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:14:33.319893 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-4595ef19-ebca-4377-bd68-5717388b7a33 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:14:33.381351 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-4595ef19-ebca-4377-bd68-5717388b7a33 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Acquired lock "refresh_cache-66b6840a-cca9-43d0-824e-2d492eb10b1d" {{(pid=98154) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:266}} Feb 19 05:14:33.543455 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO oslo.messaging._drivers.impl_rabbit [-] [deb0cc63-ccce-4796-b291-4054c1534647] Reconnected to AMQP server on 10.222.0.47:5672 via [amqp] client with port 32970. Feb 19 05:14:35.382304 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.network.neutron [None req-4595ef19-ebca-4377-bd68-5717388b7a33 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] [instance: 66b6840a-cca9-43d0-824e-2d492eb10b1d] Building network info cache for instance {{(pid=98154) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1836}} Feb 19 05:14:35.392351 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [req-99a4801f-5bea-4868-8940-1d018ebaca71 req-1aa53a04-0958-4d9f-af89-e5758616886a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "66b6840a-cca9-43d0-824e-2d492eb10b1d", "tag": "335386b1-d194-45cc-bccd-e8dfb53329a0"}]} {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:14:35.394103 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 05:14:35.394103 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: warnings.warn(msg) Feb 19 05:14:35.403366 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [req-99a4801f-5bea-4868-8940-1d018ebaca71 req-1aa53a04-0958-4d9f-af89-e5758616886a service nova] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:14:35.403876 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [req-99a4801f-5bea-4868-8940-1d018ebaca71 req-1aa53a04-0958-4d9f-af89-e5758616886a service nova] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:14:35.422678 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.compute.server_external_events [req-99a4801f-5bea-4868-8940-1d018ebaca71 req-1aa53a04-0958-4d9f-af89-e5758616886a service nova] Creating event network-changed:335386b1-d194-45cc-bccd-e8dfb53329a0 for instance 66b6840a-cca9-43d0-824e-2d492eb10b1d on hv-cinder-77642 Feb 19 05:14:35.427995 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [req-99a4801f-5bea-4868-8940-1d018ebaca71 req-1aa53a04-0958-4d9f-af89-e5758616886a service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040207 Feb 19 05:14:35.428635 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 557/1107] 10.222.0.47 () {64 vars in 1308 bytes} [Fri Feb 19 05:14:35 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 05:14:36.698297 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.network.neutron [None req-4595ef19-ebca-4377-bd68-5717388b7a33 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] [instance: 66b6840a-cca9-43d0-824e-2d492eb10b1d] Updating instance_info_cache with network_info: [{"id": "335386b1-d194-45cc-bccd-e8dfb53329a0", "address": "fa:16:3e:0c:c2:bb", "network": {"id": "6e82c627-b5d1-4c59-bf38-23c61d54a5a6", "bridge": "br-int", "label": "tempest-TestShelveInstance-86564370-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "95e9a5a891aa4f9184d68b7730fe8805", "mtu": 1450, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, "devname": "tap335386b1-d1", "ovs_interfaceid": "335386b1-d194-45cc-bccd-e8dfb53329a0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "meta": {}}] {{(pid=98154) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Feb 19 05:14:36.710290 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-4595ef19-ebca-4377-bd68-5717388b7a33 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Releasing lock "refresh_cache-66b6840a-cca9-43d0-824e-2d492eb10b1d" {{(pid=98154) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:282}} Feb 19 05:14:36.711301 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-4595ef19-ebca-4377-bd68-5717388b7a33 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] 10.222.0.47 "DELETE /compute/v2.1/os-floating-ips/38639fcb-bad4-4802-a300-9fdae8661d1e" status: 202 len: 0 microversion: 2.1 time: 4.193589 Feb 19 05:14:36.711926 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 551/1108] 10.222.0.47 () {58 vars in 1253 bytes} [Fri Feb 19 05:14:32 2021] DELETE /compute/v2.1/os-floating-ips/38639fcb-bad4-4802-a300-9fdae8661d1e => generated 0 bytes in 4195 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 19 05:14:36.722056 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-7c088513-f807-4054-a4b0-ffd32692082e tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:14:36.722715 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-7c088513-f807-4054-a4b0-ffd32692082e tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] [instance: 66b6840a-cca9-43d0-824e-2d492eb10b1d] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:14:36.731920 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-7c088513-f807-4054-a4b0-ffd32692082e tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:14:36.732500 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-7c088513-f807-4054-a4b0-ffd32692082e tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:14:36.734000 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-7c088513-f807-4054-a4b0-ffd32692082e tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:14:36.734893 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-7c088513-f807-4054-a4b0-ffd32692082e tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:14:36.801312 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-7c088513-f807-4054-a4b0-ffd32692082e tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] [instance: 66b6840a-cca9-43d0-824e-2d492eb10b1d] Going to try to terminate instance {{(pid=98153) delete /opt/stack/nova/nova/compute/api.py:2540}} Feb 19 05:14:36.926050 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-7c088513-f807-4054-a4b0-ffd32692082e tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] 10.222.0.47 "DELETE /compute/v2.1/servers/66b6840a-cca9-43d0-824e-2d492eb10b1d" status: 204 len: 0 microversion: 2.1 time: 0.208910 Feb 19 05:14:36.928640 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 558/1109] 10.222.0.47 () {58 vars in 1229 bytes} [Fri Feb 19 05:14:36 2021] DELETE /compute/v2.1/servers/66b6840a-cca9-43d0-824e-2d492eb10b1d => generated 0 bytes in 211 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 19 05:14:36.935894 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-12889bca-332f-4e1d-8738-b6272203fc84 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:14:36.937125 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-12889bca-332f-4e1d-8738-b6272203fc84 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] [instance: 66b6840a-cca9-43d0-824e-2d492eb10b1d] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:14:36.945795 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-12889bca-332f-4e1d-8738-b6272203fc84 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:14:36.946424 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-12889bca-332f-4e1d-8738-b6272203fc84 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:14:36.947546 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-12889bca-332f-4e1d-8738-b6272203fc84 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:14:36.948153 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-12889bca-332f-4e1d-8738-b6272203fc84 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:14:37.184256 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-12889bca-332f-4e1d-8738-b6272203fc84 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '878e94e8d400454790f54697f9a8f9e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e9a5a891aa4f9184d68b7730fe8805', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:14:37.194267 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-12889bca-332f-4e1d-8738-b6272203fc84 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] 10.222.0.47 "GET /compute/v2.1/servers/66b6840a-cca9-43d0-824e-2d492eb10b1d" status: 200 len: 1451 microversion: 2.1 time: 0.262309 Feb 19 05:14:37.194899 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 552/1110] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:14:36 2021] GET /compute/v2.1/servers/66b6840a-cca9-43d0-824e-2d492eb10b1d => generated 1451 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:14:38.215759 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-d33b53c4-903c-44d6-97e0-e207727d55d0 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:14:38.216538 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-d33b53c4-903c-44d6-97e0-e207727d55d0 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] [instance: 66b6840a-cca9-43d0-824e-2d492eb10b1d] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:14:38.225392 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-d33b53c4-903c-44d6-97e0-e207727d55d0 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:14:38.225841 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-d33b53c4-903c-44d6-97e0-e207727d55d0 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:14:38.226683 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-d33b53c4-903c-44d6-97e0-e207727d55d0 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:14:38.227164 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-d33b53c4-903c-44d6-97e0-e207727d55d0 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:14:38.504266 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-d33b53c4-903c-44d6-97e0-e207727d55d0 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '878e94e8d400454790f54697f9a8f9e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e9a5a891aa4f9184d68b7730fe8805', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98153) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:14:38.513211 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-d33b53c4-903c-44d6-97e0-e207727d55d0 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] 10.222.0.47 "GET /compute/v2.1/servers/66b6840a-cca9-43d0-824e-2d492eb10b1d" status: 200 len: 1451 microversion: 2.1 time: 0.302070 Feb 19 05:14:38.513830 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 559/1111] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:14:38 2021] GET /compute/v2.1/servers/66b6840a-cca9-43d0-824e-2d492eb10b1d => generated 1451 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:14:39.533376 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-6de8ad38-21d7-48b4-84f8-3d80dad9570a tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:14:39.534039 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-6de8ad38-21d7-48b4-84f8-3d80dad9570a tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] [instance: 66b6840a-cca9-43d0-824e-2d492eb10b1d] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:14:39.542035 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-6de8ad38-21d7-48b4-84f8-3d80dad9570a tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:14:39.542538 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-6de8ad38-21d7-48b4-84f8-3d80dad9570a tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:14:39.543394 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-6de8ad38-21d7-48b4-84f8-3d80dad9570a tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:14:39.543883 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-6de8ad38-21d7-48b4-84f8-3d80dad9570a tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:14:39.713881 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-6de8ad38-21d7-48b4-84f8-3d80dad9570a tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '878e94e8d400454790f54697f9a8f9e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e9a5a891aa4f9184d68b7730fe8805', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:14:39.723371 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-6de8ad38-21d7-48b4-84f8-3d80dad9570a tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] 10.222.0.47 "GET /compute/v2.1/servers/66b6840a-cca9-43d0-824e-2d492eb10b1d" status: 200 len: 1380 microversion: 2.1 time: 0.194700 Feb 19 05:14:39.724208 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 553/1112] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:14:39 2021] GET /compute/v2.1/servers/66b6840a-cca9-43d0-824e-2d492eb10b1d => generated 1380 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 05:14:39.823177 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [req-6fb1d99f-1e0c-466b-bffb-fa47b26c61f8 req-bd92cd85-897c-426a-ab83-91bf3c1a0a67 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66b6840a-cca9-43d0-824e-2d492eb10b1d", "name": "network-vif-deleted", "tag": "335386b1-d194-45cc-bccd-e8dfb53329a0"}]} {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 05:14:39.825318 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 05:14:39.825318 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: warnings.warn(msg) Feb 19 05:14:39.835002 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [req-6fb1d99f-1e0c-466b-bffb-fa47b26c61f8 req-bd92cd85-897c-426a-ab83-91bf3c1a0a67 service nova] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:14:39.835567 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [req-6fb1d99f-1e0c-466b-bffb-fa47b26c61f8 req-bd92cd85-897c-426a-ab83-91bf3c1a0a67 service nova] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:14:39.854563 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.compute.server_external_events [req-6fb1d99f-1e0c-466b-bffb-fa47b26c61f8 req-bd92cd85-897c-426a-ab83-91bf3c1a0a67 service nova] Creating event network-vif-deleted:335386b1-d194-45cc-bccd-e8dfb53329a0 for instance 66b6840a-cca9-43d0-824e-2d492eb10b1d on hv-cinder-77642 Feb 19 05:14:39.860224 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [req-6fb1d99f-1e0c-466b-bffb-fa47b26c61f8 req-bd92cd85-897c-426a-ab83-91bf3c1a0a67 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041034 Feb 19 05:14:39.860899 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 560/1113] 10.222.0.47 () {64 vars in 1308 bytes} [Fri Feb 19 05:14:39 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 05:14:40.743060 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-5f6e6bd9-560c-4e89-be73-3dbc365e5781 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Calling method '>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:14:40.743774 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-5f6e6bd9-560c-4e89-be73-3dbc365e5781 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] [instance: 66b6840a-cca9-43d0-824e-2d492eb10b1d] Fetching instance by UUID {{(pid=98154) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:14:40.754193 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-5f6e6bd9-560c-4e89-be73-3dbc365e5781 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:14:40.754712 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-5f6e6bd9-560c-4e89-be73-3dbc365e5781 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:14:40.755654 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-5f6e6bd9-560c-4e89-be73-3dbc365e5781 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:14:40.756154 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-5f6e6bd9-560c-4e89-be73-3dbc365e5781 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:14:40.835244 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-5f6e6bd9-560c-4e89-be73-3dbc365e5781 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:14:40.835833 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-5f6e6bd9-560c-4e89-be73-3dbc365e5781 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98154) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:14:40.836440 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.objects.instance [None req-5f6e6bd9-560c-4e89-be73-3dbc365e5781 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Lazy-loading 'fault' on Instance uuid 66b6840a-cca9-43d0-824e-2d492eb10b1d {{(pid=98154) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Feb 19 05:14:40.925702 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.policy [None req-5f6e6bd9-560c-4e89-be73-3dbc365e5781 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '878e94e8d400454790f54697f9a8f9e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e9a5a891aa4f9184d68b7730fe8805', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98154) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 05:14:40.935396 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-5f6e6bd9-560c-4e89-be73-3dbc365e5781 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] 10.222.0.47 "GET /compute/v2.1/servers/66b6840a-cca9-43d0-824e-2d492eb10b1d" status: 200 len: 1224 microversion: 2.1 time: 0.196899 Feb 19 05:14:40.936695 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 554/1114] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:14:40 2021] GET /compute/v2.1/servers/66b6840a-cca9-43d0-824e-2d492eb10b1d => generated 1224 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 05:14:41.955515 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-43984a78-63aa-4dee-b557-b1ce16fccdf5 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Calling method '>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:14:41.956477 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.compute.api [None req-43984a78-63aa-4dee-b557-b1ce16fccdf5 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] [instance: 66b6840a-cca9-43d0-824e-2d492eb10b1d] Fetching instance by UUID {{(pid=98153) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 05:14:41.964789 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-43984a78-63aa-4dee-b557-b1ce16fccdf5 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:14:41.965292 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-43984a78-63aa-4dee-b557-b1ce16fccdf5 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:14:41.966127 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-43984a78-63aa-4dee-b557-b1ce16fccdf5 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 05:14:41.966613 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG oslo_concurrency.lockutils [None req-43984a78-63aa-4dee-b557-b1ce16fccdf5 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Lock "8317eecd-4287-4458-b94f-e801df0b7699" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98153) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 05:14:42.019853 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.wsgi [None req-43984a78-63aa-4dee-b557-b1ce16fccdf5 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] HTTP exception thrown: Instance 66b6840a-cca9-43d0-824e-2d492eb10b1d could not be found. Feb 19 05:14:42.020511 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-43984a78-63aa-4dee-b557-b1ce16fccdf5 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Returning 404 to user: Instance 66b6840a-cca9-43d0-824e-2d492eb10b1d could not be found. {{(pid=98153) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 19 05:14:42.021411 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-43984a78-63aa-4dee-b557-b1ce16fccdf5 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] 10.222.0.47 "GET /compute/v2.1/servers/66b6840a-cca9-43d0-824e-2d492eb10b1d" status: 404 len: 111 microversion: 2.1 time: 0.071266 Feb 19 05:14:42.022020 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 561/1115] 10.222.0.47 () {58 vars in 1226 bytes} [Fri Feb 19 05:14:41 2021] GET /compute/v2.1/servers/66b6840a-cca9-43d0-824e-2d492eb10b1d => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 05:14:42.030832 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-cc7b39f5-26e9-41a3-87a0-b01dd75a135e tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Calling method '.version_select at 0x7f27067f9a60>' {{(pid=98154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:14:42.274413 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-cc7b39f5-26e9-41a3-87a0-b01dd75a135e tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] 10.222.0.47 "DELETE /compute/v2.1/os-security-groups/9897a4e1-e93b-43f8-8404-7e98cf7b0511" status: 202 len: 0 microversion: 2.1 time: 0.247492 Feb 19 05:14:42.275068 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98154|app: 0|req: 555/1116] 10.222.0.47 () {58 vars in 1262 bytes} [Fri Feb 19 05:14:42 2021] DELETE /compute/v2.1/os-security-groups/9897a4e1-e93b-43f8-8404-7e98cf7b0511 => generated 0 bytes in 249 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 19 05:14:42.283770 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: DEBUG nova.api.openstack.wsgi [None req-8c91d17d-867e-4098-ad43-72b5a3c39e45 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] Calling method '.version_select at 0x7f2706936840>' {{(pid=98153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 05:14:42.304745 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO nova.api.openstack.requestlog [None req-8c91d17d-867e-4098-ad43-72b5a3c39e45 tempest-TestShelveInstance-290072937 tempest-TestShelveInstance-290072937-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1039927372" status: 202 len: 0 microversion: 2.1 time: 0.024972 Feb 19 05:14:42.305374 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: [pid: 98153|app: 0|req: 562/1117] 10.222.0.47 () {58 vars in 1244 bytes} [Fri Feb 19 05:14:42 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1039927372 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 19 05:15:16.091685 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 19 05:15:16.092214 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: Fri Feb 19 05:15:16 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 19 05:16:15.166789 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 19 05:16:15.167425 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: Fri Feb 19 05:16:15 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 19 05:16:15.523982 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 19 05:16:15.524202 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: Fri Feb 19 05:16:15 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 19 05:16:17.885746 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 19 05:16:17.886222 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: Fri Feb 19 05:16:17 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 19 05:16:48.508335 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 19 05:16:48.508941 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: Fri Feb 19 05:16:48 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 19 05:18:36.110143 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 19 05:18:36.110706 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: Fri Feb 19 05:18:36 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 19 05:19:35.184596 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 19 05:19:35.185240 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: Fri Feb 19 05:19:35 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 19 05:19:35.541165 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 19 05:19:35.541401 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: Fri Feb 19 05:19:35 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 19 05:19:37.902403 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 19 05:19:37.902855 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: Fri Feb 19 05:19:37 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 19 05:20:08.526197 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 19 05:20:08.526771 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: Fri Feb 19 05:20:08 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 19 05:20:09.110377 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 19 05:20:09.110377 dv-cinder-776422-3-iscsi devstack@n-api.service[98151]: Fri Feb 19 05:20:09 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!